Picture changer with recording and playback capability

ABSTRACT

A display apparatus ( 18 ) capable of sequentially displaying a plurality of annotated image prints ( 36 ), each image print having encoded audio data ( 54 ) made integral to its back surface ( 46 ), thereby providing a convenient way to both display image prints and play back audio data associated with image prints. In one aspect, the display apparatus ( 18 ) also records audio data for a plurality of image prints and provides a handwritten means to electronically associate a particular image print with its respective audio recording. In other aspects, the display apparatus ( 18 ) also includes means for integrating encoded data ( 54 ) with the image prints and recording, storing and playing back data corresponding to a portfolio of image prints. There is also a method of capturing images and corresponding audio messages, integrating the audio messages with the back surfaces ( 46 ) of image prints made from the images, and displaying the image prints while playing back the corresponding audio messages.

[0001] This invention relates to a method and apparatus for displayingimage prints and for recording and playback of annotation where suchannotation is made integral to the image prints.

BACKGROUND OF THE INVENTION

[0002] Image annotation is the process of adding supplementalinformation relating to an image print for the purpose of enhancingenjoyment or for future reference. As such, the ability to record andplayback annotation relating to image prints has broad applications inmany different fields. For example, in the field of photography,recording of one's own voice annotation that can later be played backenhances one's enjoyment and memory recollection of the eventssurrounding the photos. In the field of tourism, post cards that canbear audio narration can serve as a tour guide of the places to visitand memorabilia to keep afterwards. In the field of children'seducation, picture cards that can narrate their story lines provide afun way for children to learn reading skills.

[0003] There have been various past attempts to record and playbackannotation on traditional photographic prints. Numerous prior artreferences teach the use of a separate storage medium such as magneticdisc; tape, electronic memory element or optical memory element to holdsound information. The sound information is then logically associatedwith the photographic prints through a specialized album or displayapparatus. The disadvantage of this approach is that the sound storagemedia can become easily disassociated with the photographic printsthrough handling. The storage media is also susceptible to beingphysically lost, destroyed or erased. Other prior art references teachintegrating sound information with the image prints. This approacheliminates the risk of separation and mix-up of audio information fromthe image prints, and is the subject of the following discussion.

[0004] Within this approach, various methods of integrating magnetic,semiconductor and optical memory containing sound information with theimage print are found in the prior art. In addition, a number of priorart references teach the use of optical encoding directly on a mediawithout the use of a separate storage means. Some of the prior artdisclosing the magnetic methods of storage are as follows:

[0005] In U.S. Pat. No. 4,270,854 issued to Stemme, et al. on Jun. 2,1981, sound is recorded on an instant print by placing the print, afterit has been ejected, into an auxiliary slot in the camera and thenproceeding to record the audio on a magnetic strip integral to the printborder. The only method disclosed for playback is with the camera.

[0006] Similarly, in U.S. Pat. No. 4,905,029 issued to Kelly on Feb. 27,1990, sound is recorded using a magnetic strip which is eitherintegrally formed with instant print material or is separable for laterattachment. It provides a limited audio storage space and is awkward toreproduce the sound while viewing the print. It requires a magneticreader head employing relative motion between the head and magneticstrip for signal reproduction. This system is prone to mechanicalfailure.

[0007] Also, U.S. Pat. No. 5,920,737 issued to Marzen et al. on Jul. 6,1999 discloses an apparatus that has a recording/applicator mechanismwhich applies a recorded magnetic tape strip to photographsautomatically when the photograph is positioned within the applicatormechanism. Unfortunately, all such magnetic recording media have alimited life span that includes inherent loss of the magneticallyrecorded data over time.

[0008] Some other prior art references disclosing the semiconductormemory methods are as follows:

[0009] U.S. Pat. No. 5,365,686 to Scott, issued Nov. 22, 1994, shows aU-shaped plastic sleeve for holding a photograph, which sleeve includesan integral IC memory chip into which audio data can be recorded andfrom which it can be retrieved. The sleeve can be “plugged in” to aplayer whereby electrical contact is made with the player. This systemhas the disadvantage of added cost and bulk to the image prints.

[0010] Also, U.S. Pat. No. 5,878,292 to Bell et al, issued on Mar. 2,1999, discloses the method of making of an image-audio print whereby theimage print is adhesively attached to a backing containing audio storagemeans such as EPROM or EEPROM. When such image-audio print is insertedinto a player, it makes electrical contact with the player's apparatusand thereby plays back the message stored in the integral audio storage.According to the invention, this backing material adds “heft” to theprint. For many people, this added heft may be undesirable.

[0011] Still some of the other prior art references disclosing theoptical methods are as follows:

[0012] U.S. Pat. No. 4,983,996 discloses a camera having a microphonewhich optically records sound data in a bar code pattern along theborder of the film. The camera is provided with a detachably connectablebar code reader which is used, once the film is developed and printed,to scan the code along the print border to play the voice or soundrecording associated with the print. This system provides for a limitedamount of sound recording.

[0013] Also, U.S. Pat. No. 5,276,472, issued to Bell et al on Jan. 4,1994, describes a sound capturing camera that first stores a soundrecord onto a transparent magnetic coating on the film. This soundrecord is then transferred to the back of a print with an ink jetprinter or thermally formed blisters or writing the sound record as abar code on the area adjacent to an image on the front of the print. Ahand-held device is used on the print to read the sound record from theprint and play back the sound record. This system requires writing theentire sound record on the print and in one case, proposes creating anunsightly pattern bearing the sound record adjacent to the image on theprint.

[0014] U.S. Pat. No. 5,521,663, granted to Norris on May 28, 1996,discloses recording sound by the camera directly onto the film using alatent image binary code. The binary code is imaged onto the print atthe time the print is exposed. The code is decoded into sound by ascanner in the playback device. This system uses up valuable image areaon the image print for the sound code.

[0015] Further, U.S. Pat. No. 5,995,193 issued to Stephany et al on Nov.30, 1999, discloses a self-contained device for recording and playbackof data on a medium such as photographic print. The recording can bedone in either or both visible and invisible ink and playback can detecteither or both visible and invisible ink. A print is inserted into thedevice for recording and playback. This device is not suitable forportable enjoyment of sound reproduction.

[0016] Similarly, U.S. Pat. No. 6,094,279 to Soscia, issued Jul. 25,2000, discloses the use of a printed invisible encodement on aphotographic image to record sound information. The invisible image isproduced by development of a photographic emulsion layer, inkjetprinting, thermal dye transfer printing or other printing method. Theencodement is a one or two-dimensional array of encoded data. Thisapproach requires printing on the face of the photographic prints, andto avoid problems, the materials used, including materials in the layersof the photographs, are selected to avoid undesirable interactions. Thisis acceptable for new prints, but is difficult to adapt for existingprints. It is also likely that for many people, subjecting valuedphotographs to an elective modification, thus risking even a smallchance of damage or loss, is unacceptable.

[0017] From the above, it is clear that there is a desire to associatesound and other data with print images. Unfortunately, as indicatedabove, each of the aforementioned systems has one or more disadvantages.

BRIEF SUMMARY OF THE INVENTION

[0018] Briefly summarized, a general object of one preferred aspect ofthe present invention is to overcome the above shortcomings by providingan apparatus and method for displaying image prints and playing backannotation that has been integrated on a back surface thereof.

[0019] An object of another preferred aspect of the present invention isto provide an apparatus and method for recording and associatingannotation with a corresponding image print and for playing back theannotation when the corresponding image print is displayed.

[0020] An object of yet another preferred aspect of the invention is toprovide a method of encoding annotation related to an image print andintegrating the annotation in the form of a two-dimensional encodementformat with the back surface of the image print.

[0021] An object of a further preferred aspect of the present inventionis to provide an apparatus and method for recording annotationassociated with image prints, integrating the annotation with the backsurface of a corresponding image print, and displaying the image printwhile playing back the corresponding annotation.

[0022] An object of another preferred aspect of the present invention isto provide a method of capturing images and audio messages correspondingto the images, integrating the audio messages with image prints madefrom the images; and displaying the image prints while playing back thecorresponding audio messages.

[0023] An object of yet another preferred aspect of the presentinvention is to provide an apparatus and method for recording, storingand playing back data corresponding to a portfolio of image prints.

[0024] An object of other preferred embodiments of the present inventionis make the apparatus portable, self-contained and battery operated.

[0025] In accordance with one preferred aspect of the present inventionthen, there is provided a display apparatus including display means forholding a plurality of image prints and for displaying the image printssuccessively in a viewing aperture, and advance means for sequentiallyadvancing the image prints one at a time to the viewing aperture,comprising: scanning means for scanning a machine-readable data on aback surface of at least one of the plurality of image prints, themachine-readable data being integral to the back surface of the at leastone image print; decoding means for decoding the machine-readable datawherein the machine-readable data comprises audio data, machine data, ortext data; storage means for storing the decoded machine-readable datacorresponding to the at least one scanned image print; and playbackmeans for playing back from the storage means the decodedmachine-readable data corresponding to the at least one scanned imageprint when the at least one scanned image print is displayed at theviewing aperture, whereby the display apparatus is convenient for bothdisplaying image prints and for playing back the corresponding decodedmachine-readable data.

[0026] In accordance with another preferred aspect of the presentinvention, there is provided a display apparatus comprising displaymeans for holding a plurality of image prints and for displaying theimage prints successively in a viewing aperture, and advance means forsequentially advancing the image prints one at a time to the viewingaperture, comprising: scanning means for scanning a handwritten indiciaon the back surface of at least one of the plurality of image prints;decoding means for decoding the scanned indicia wherein the indiciacontains identification information unique to the at least one scannedimage print; recording means for recording audio corresponding to the atleast one scanned image print, storage means for storing the recordedaudio corresponding to the at least one scanned image print at a uniquestorage location uniquely associated with the identificationinformation; playback means for playing back from the unique storagelocation the recorded audio corresponding to the at least one scannedimage print when the at least one scanned image print is displayed atthe viewing aperture, whereby the indicia provides a means to correspondthe at least one image print with the corresponding audio recording, andwhereby the display apparatus is convenient for both displaying imageprints and playing back audio associated with the image prints.

[0027] A method for sequentially displaying a stack of image prints in adisplay apparatus, comprising the steps of: placing the stack of imageprints into the display apparatus; scanning a machine-readable data froma back surface of a bottom-most stacked image print wherein themachine-readable data comprises audio data, machine data, or text data,and wherein the machine-readable data is integral to the back surface ofthe bottom-most stacked image print; decoding the scannedmachine-readable data corresponding to the bottom-most stacked imageprint and storing the scanned machine-readable data corresponding to thebottom-most stacked image print in a storage means; advancing thebottom-most stacked image print to a top-most position of the stack andinto a viewing aperture; playing back the decoded scannedmachine-readable data stored in the storage means corresponding to thetop-most stacked image print displayed in the viewing aperture, wherebythe display apparatus is convenient for both displaying image prints andplaying back the machine-readable data associated with the image prints.

[0028] A method of sequentially displaying a stack of image prints in adisplay apparatus, comprising the steps of: placing the stack of imageprints into the display apparatus; scanning a handwritten indicia on aback surface of a bottom-most print; decoding the scanned indiciawherein the indicia contains identification information unique to thebottom-most stacked image print, advancing the bottom-most stacked imageprint to a top-most position of the stack and into a viewing aperture;recording an audio corresponding to the top-most stacked image print;storing the recorded audio corresponding to the top-most stacked imageprint in a storage means at a storage location uniquely associated withthe identification information corresponding to the top-most stackedimage print; playing back from the storage means the recorded audiocorresponding to the top-most stacked image print displayed at theviewing aperture of the display apparatus, whereby the indicia providesa means to correspond the top-most stacked image print with thecorresponding audio recording, and whereby the display apparatus isconvenient for both displaying image prints and playing back audioassociated with the image prints.

[0029] A method of recording a machine-readable data on a back surfaceof an image print, the machine-readable data representative of an audiorecording corresponding to the image print, comprising the steps of:outputting the audio recording from a display apparatus used to recordthe audio recording; converting the audio recording into themachine-readable data using an algorithmic encoding process, wherein themachine-readable data is a two-dimensional encodement format; printingthe machine-readable data using a printing device and integrating themachine-readable data with the back surface of the corresponding imageprint, whereby the audio recording is made integral to the image print.

[0030] An annotation and display apparatus, comprising: display meansfor holding a plurality of image prints and for displaying the imageprints successively in a viewing aperture; advance means forsequentially advancing the image prints one at a time to the viewingaperture; recording means for recording an audio message correspondingto at least one of the image prints; encoding means for encoding therecorded audio message into a machine-readable data; imprinting meansfor imprinting the machine-readable data and integrating themachine-readable data on a back surface of the at least one image print;scanning means for scanning the machine-readable data integral on theback surface of the at least one image print; decoding means fordecoding the machine-readable data into a decoded audio messagecorresponding to the at least one image print; playback means forplaying back the decoded audio message when the at least one image printis displayed in the viewing aperture of the display apparatus wherebythe display apparatus is convenient for displaying image prints and forimprinting and playing back the corresponding decoded audio messages.

[0031] A method of annotating and displaying image prints using adisplay apparatus comprising the steps of: recording an audio messagecorresponding to at least one of the image prints; encoding the recordedaudio message into a machine-readable data; imprinting themachine-readable data using an imprinter attached to the displayapparatus, and integrating the machine-readable data on a back surfaceof the at least one image print; scanning the machine-readable dataintegral on the back surface of the at least one image print; decodingthe machine-readable data into a decoded audio message corresponding tothe at least one image print; displaying the at least one image print ina viewing aperture of the display apparatus; and playing back thedecoded audio message corresponding to the displayed image print,whereby the recorded audio message is made integral to the back surfaceof the at least one image print and is played back while the at leastone image print is displayed in the display apparatus.

[0032] A method for combining images with corresponding audio messagesand for displaying the images and playing back the corresponding audiomessages in a display apparatus comprising the steps of: capturing atleast one the image using a camera, the camera also capable of recordingthe corresponding audio messages; using the camera to record at leastone the corresponding audio message for the at least one image in astorage medium; producing an image print from the at least one capturedimage; encoding the at least one recorded corresponding audio messagestored in the storage medium into a machine-readable data; imprintingthe machine-readable data and integrating the machine-readable data on aback surface of the image print; scanning the machine-readable dataintegral on the back surface of the image print; decoding themachine-readable data into a decoded audio message corresponding to theimage print; displaying the image print in a viewing aperture of thedisplay apparatus; and playing back the decoded audio messagecorresponding to the displayed image print, whereby the at least onerecorded audio message made while capturing the at least one image ismade integral to the back surface of the corresponding image print andis played back while the image print is displayed in the displayapparatus.

[0033] A portfolio annotation apparatus, comprising: a detachablecassette for holding image prints, the cassette and the image printscomprising a portfolio; a portfolio recording means for recording datacharacterizing the portfolio, wherein the data comprises audio data,machine data, or text data; a storage means attached to the cassette forstoring the data; and a portfolio playback means for playing back fromthe storage means the data characterizing the portfolio; whereby thecassette is a convenient means for organizing and categorizing imageprints and the portfolio recording means is a convenient way tocharacterize the content of the portfolio for storage and laterplayback.

[0034] A method of annotating a portfolio of image prints comprising thesteps of: placing at least one image print into a detachable cassette,the at least one image print and the cassette comprising the portfolio;placing the portfolio into an apparatus, the apparatus having recordingand playback means; recording data corresponding to the portfolio,wherein the data comprise audio data, machine data, or text data;storing the data in a storage element attached to the cassette; andplaying back from the storage element the data corresponding to theportfolio; whereby using the detachable cassettes is a convenient way toorganize and categorize image prints into the portfolios, and recordingdata corresponding to the portfolios is a convenient way to characterizethe content of the portfolios for storage and later playback.

[0035] Several advantageous features of the preferred embodiments of thepresent invention are as follows:

[0036] (a) the apparatus and method for annotating photographic printsis compatible with both existing and newly processed prints;

[0037] (b) the apparatus and method for annotating a photographic printprovides annotation that is made integral to the print therebyprecluding the annotation from becoming separated from the print;

[0038] (c) the apparatus and method of annotating a photographic printproduces no obtrusive markings on the image surface of the print duringthe annotation process so as to avoid detracting from enjoyment of theimage;

[0039] (d) the apparatus and method for annotating a photographic printproduces annotation that will last as long as the photographic printitself and not be degraded significantly with use or over time, nor besubject to accidental erasure;

[0040] (e) the annotation produced on photographic prints is retrievedthrough non-contact means so as to avoid physical degradation of theprints or the annotation;

[0041] (f) the apparatus will make available, for audio annotation onphotographic prints, at least 10 seconds of recording per photographicprint;

[0042] (g) the apparatus holds a plurality of photographic prints which,when actuated by a user, displays each print successively while playingback annotation associated with the particular print, thereby enhancingthe viewing enjoyment of each print;

[0043] (h) the apparatus for retrieving annotation on photographicprints that is portable and battery operated;

[0044] (i) the apparatus includes means for recording annotationcorresponding to photographic prints and for storing the recordedannotation along with the corresponding prints within the apparatus;

[0045] (j) the apparatus includes a detachable storage element whichholds stored annotation;

[0046] (k) the method and apparatus include means whereby the ordinaryuser can annotate photographic prints at home without need of anyelaborate equipment;

[0047] (l) the method and apparatus include means for annotatingphotographic prints with human readable information;

[0048] (m) the method and apparatus include means whereby the annotationon a photographic print is retrievable even when the prints are mountedin a photo album;

[0049] (n) the apparatus is capable of generating synthesized speechthereby allowing playback of annotation comprising longer audio messagesthan digitized audio;

[0050] (o) the apparatus is capable of transferring annotation data toan external device;

[0051] (p) the apparatus is further capable of interacting with a userthrough a touch screen; and

[0052] (q) the apparatus is also capable of electronically displayinginformation to a user.

[0053] Further advantages of preferred embodiments of the presentinvention are as follows:

[0054] (a) a system is provided that is compatible with commerciallyavailable image printing devices, thus obviating the need for thedevelopment and manufacture of specialized printing machinery;

[0055] (b) the apparatus for displaying photographic prints and playingback annotation on those prints that is durable and reliable;

[0056] (c) the apparatus and method for annotation photographic printsand playing back said annotation is inexpensive to manufacture, andaccordingly will sell at a low price, thereby making such photographannotation and display apparatus economically available to the averageconsumer.

[0057] Further objects and advantages of the present invention will beapparent from the following description and the appended drawings,wherein preferred embodiments of the invention are clearly described andshown.

BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The present invention will be further understood from thefollowing description with reference to the drawings in which:

[0059]FIG. 1 is a perspective view of the display apparatus of apreferred embodiment of the present invention, facing up with the drawerfully open.

[0060]FIG. 2A is a perspective view of the apparatus shown in FIG. 1,facing down with the drawer fully closed.

[0061]FIG. 2B is the display apparatus shown in FIG. 2A with thecontroller housing separated from the frame housing.

[0062]FIG. 3 is a cross-sectional view of the display apparatus shown inFIG. 2A along line 3-3.

[0063]FIG. 4 is an exemplary representation of the back surface of animage print used in the display apparatus shown in FIG. 1.

[0064]FIG. 5 is a block schematic diagram of the electrical subsystem ofthe display apparatus shown in FIG. 1.

[0065]FIG. 6 is a logic flow diagram showing the operation of thedisplay apparatus shown in FIG. 1.

[0066]FIG. 7 is a perspective view of a further preferred embodiment ofthe display apparatus of the present invention, facing up.

[0067]FIG. 8 is an exemplary representation of the back surface of animage print used in the preferred embodiment of the present inventionshown in FIG. 7.

[0068]FIG. 9 is a block schematic diagram of the electrical subsystem ofthe preferred embodiment of the display apparatus of the presentinvention shown in FIG. 7.

[0069]FIGS. 10A and 10B are logic flow diagrams showing the operation ofthe preferred embodiment of the display apparatus of the presentinvention shown in FIG. 7.

[0070]FIGS. 11A to 11D are perspective views of four configurations of asecond further preferred embodiment of the invention, showing means forimprinting image prints.

[0071]FIG. 12 is a block schematic diagram of the electrical subsystemof the display apparatus shown in FIGS. 11A to 11D and FIG. 13.

[0072]FIG. 13 is a perspective view of a detachable cassette of a fourthfurther preferred embodiment of the invention.

[0073] REFERENCE NUMERALS SHOWN IN DRAWINGS 18 display apparatus 20frame housing 21 print holder 22 controller housing 23 controller 24sliding drawer 26 viewing aperture 28 side walls 30 front wall 32 floor33 opening in the floor 34 slot 36 a stack or portfolio of image prints38 loudspeaker 40 supporting surface 41 separator bar 42 drawer switch43 actuating lever 46 a back surface of an image print 48 thebottom-most image print 49 the top-most image print 52 scanning window54 encoded data 56 mirror 58 image sensor 59 illuminator 60 optical path61 optical path 66 human readable information 72 processor 74nonvolatile memory 76 random access memory 77 read-only memory 78 audioamplifier 80 digital signal processor 82 batteries 90 microphone 92record switch 94 transceiver 96 data connector 100 picture ID (PID) 110routine to process PID information 112 routine to perform audiorecording 115 micro printer 120 sliding drawer handle 124 input slot 126output slot 130 an image print 134 portfolio recording switch 140 memoryslot 142 storage element 144 label 224 detachable cassette 44, 50, 132,133, 150 arrows

GLOSSARY

[0074] The following are definitions of terms used in the ensuingdescription and are provided to aid in understanding the applicant'sinvention.

[0075] IMAGE PRINT: The most common form being a photographic print, butmay also be any printed sheet from which a visual image can beperceived, such as post cards, picture cards, flash cards, drawings,letterings and the like.

[0076] ANNOTATION: Information related to an IMAGE PRINT. Annotation maycomprise human readable information and machine-readable data. Humanreadable information may comprise text, handwritings, drawings and thelike. Machine-readable data, embodied in a storage means, may comprisesound data, machine data, text data and the like. Sound, data maycomprise human speech, voice, singing, music, animal noises, synthesizedspeech, synthesized sounds and the like. Machine data may comprisebinary data, machine instructions and the like.

[0077] AUDIO DATA: Sound data that is digitized and compressed fordigital storage and transmission.

[0078] ENCODED DATA: machine-readable data embodied in a two-dimensionalsymbology and printed on a sheet.

[0079] The following descriptions of the embodiments of the presentinvention refer to various conventions such as “top”, “bottom”,“uppers”, “lower”, “under”, ““underside”, etc. These descriptors aremade only to provide a frame of reference and should not limit thedescription provided herein. Although the present invention referencesimage prints as photographic prints, and annotation as human speech orvoice, it should be understood that other forms of image print andannotation as described in the Glossary definitions contained herein canbe utilized with the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE INVENTION

[0080] Description of a First Preferred Embodiment—FIGS. 1 to 6

[0081] With reference to FIGS. 1 to 6, a first preferred embodiment ofthe present invention will be described in detail as this willfacilitate the understanding of further preferred embodiments describedlater.

[0082] Referring to FIG. 1, a display apparatus 18 comprises two mainparts, a print holder 21 and a controller 23. The print holder 21comprises a frame housing 20 with a viewing aperture 26 made of a clearor transparent plastic material and a sliding drawer 24 which isslidably engageable within frame housing 20. Sliding drawer 24 ispreferably a one-piece element having a floor 32, a pair of side walls28, a front wall 30 joining side walls 28 and a separator bar 41 (shownin FIG. 3) which altogether form a drawer-like structure. Sliding drawer24 is made to be slidably engageable within a defined slot 34 in framehousing 20 in the directions shown by an arrow 50. Sliding drawer 24 canbe pulled out of frame housing 20 for a distance limited by stop members(not shown) on separator bar 41 and complementary stop members (notshown) on frame housing 20. Sliding drawer 24 is sized for receiving andsupporting a stack of image prints 36 arranged therein for displaythrough viewing aperture 26. Viewing aperture 26, is made with clear ortransparent plastic material, and is sized to display the individualimage prints from the stack of image prints 36. Additional detailsrelating to the structure of frame housing 20 and sliding drawer 24 aredescribed in greater detail in U.S. Pat. No. 4,939,860, issued to P.Ackeret and assigned to Licinvist, A G which is hereby incorporated byreference. Controller 23 comprises a controller housing 22 and partscontained therein. An audio loudspeaker 38 attaches to an exteriorsupporting surface 40 of controller housing 22. Controller housing 22attaches to the bottom of frame housing 20. Both frame housing 20 andcontroller housing 22 are preferably formed from injection-moldedplastic.

[0083]FIG. 2A is an underside view of display apparatus 18, showingcontroller 23, controller housing 22, print holder 21, frame housing 20,sliding drawer 24 in a fully closed position, and slot 34 in framehousing 20. FIG. 2B shows display apparatus 18 of FIG. 2A withcontroller housing 22 separated to expose optical related componentscontained therein. The optical components contained in controllerhousing 22 include an image sensor 58, a mirror 56 fixed at apredetermined angle and positioned above a scanning window 52, anilluminator 59 at one edge of scanning window 52, and another identicalilluminator (not shown for simplification) at an opposite edge ofscanning window 52. Image sensor 58 comprises a solid-state sensor and apredetermined lens to attain focus and a substantially full-image viewof an encoded data 54 along an optical path 60, 61. Mirror 56 is afront-surface or first-surface type to minimize light loss and secondaryrefraction. Illuminator 59 comprises a bank of light-emitting diodes(LEDs) mounted in close proximity to each other so as to cast a uniformillumination on encoded data 54 on a back surface 46 (see FIG. 3) of abottom-most image print 48. Alternatively, illuminator 59 may be anyother light emitting devices capable of illuminating encoded data 54. Adrawer switch 42 is positioned to sense the opening and closing ofsliding drawer 24.

[0084] Mirror 56 is used to keep the profile or the thickness of displayapparatus 18 to a minimum so it can be grasped easily with one hand,Without mirror 56, image sensor 58 would need to be located directlybehind scanning window 52 at a distance equal to optical paths 60, 61.An alternative means of achieving a low profile is to use a linearlytranslating scanning mechanism (not shown) directly above scanningwindow 52 to perform the function of image scanning. Such a lineartranslating scanning mechanism can be based on the same principle asthose found in desktop flatbed scanners, utilizing a charge-coupledevice (CCD) sensor or contact image sensor (CIS) mounted on a motorizedmoving carriage (not shown). Motorization of the carriage would not berequired if the carriage is affixed (not shown) to sliding drawer 24such that the action of pulling-out/pushing-in sliding drawer 24 by theuser achieves the linear translating motion necessary for scanning.These techniques of scanning are conventionally known to those skilledin the art. In a further alternative, image sensor 58 can be located inclose proximity to scanning window 52 through the use of a wide-anglelens (not shown). A wide-angle lens can introduce spherical distortion,however, appropriate use of mathematical algorithms known in the art,can correct for such distortion.

[0085]FIG. 3 shows a cross-sectional view of display apparatus 18 alongline 3-3 of FIG. 2A. In this face down view, sliding drawer 24 is fullyengaged within frame housing 20. While in this position, separator bar41, which forms the innermost part of the drawer-like structure, engagesan actuating lever 43 of drawer switch 42. Actuating lever 43 isspring-loaded against separator bar 41 in the direction shown by anarrow 44. With sliding drawer 24 fully engaged within frame housing 20as shown in FIG. 3, drawer switch 42 is electrically open. When slidingdrawer 24 is disengaged from frame housing 20 as shown in FIG. 1, drawerswitch 42 is electrically closed, or activated. The stack of imageprints 36 is loaded within sliding drawer 24. A top-most image print 49is visible through viewing aperture 26. Encoded data 54 imprinted onback surface 46 of bottom-most image print 48 is exposed to mirror 56through an opening 33 in floor 32 of sliding drawer 24 and throughscanning window 52. Controller housing 22, which is attached to theunderside of frame housing 20 holds front-surface mirror 56 at apredetermined angle.

[0086] In summary, the optical elements described herein allow an imageof encoded data 54 to travel along optical path 60, 61, first throughopening 33 in floor 32 of sliding drawer 24, then through scanningwindow 52, then reflecting off front-surface mirror 56 and finallystriking image sensor 58.

[0087]FIG. 4 shows an exemplary imprinting on back surface 46 of animage print. A human readable information 66, along with encoded data 54containing audio data, are disposed substantially in the same locationon each image print of the stack of image prints 36. More specifically,encoded data 54 is located on the image print where it will besubstantially centered within scanning window 52 when the image print isat the bottom of sliding drawer 24, and sliding drawer 24 is fullyengaged within frame housing 20. The format of encoded data 54 may beany two-dimensional encodement having the capacity to hold digitizedhuman speech as described in more detail below. Preferably, theencodement format is that of PaperDisk™ marketed by CobblestoneSoftware, Inc., of Lexington, Mass. An example of PaperDisk™ encodementformat is shown by encoded data 54 in FIG. 4. Alternatively,two-dimensional high-density bar code formats may also be utilized suchas Aztec Code, SuperCode, Data Matrix and QR Code which areconventionally known to those skilled in the art. In general, encodeddata 54 holds at least 2,000 bytes, preferably at least about 4,000bytes and most preferably at least about 6,000 bytes of digitalinformation. The imprinting process may be done at the user's ownpremise using a computer, a printer and a predetermined software, or asa step in the photo finishing process of the photographic print by thephoto finishing laboratory. Encoded data 54 is made integral to backsurface 46 either by being imprinted directly on back surface 46 of animage print by a printing device (not shown) or by being imprinted on anadhesive label (not shown) first and then affixed to back surface 46 ofan image print. Furthermore, while encoded data 54 can be visible ordiscernible by the naked eye, it need not be. Encoded data 54 may beimprinted with ink or dye that is either within or outside the visiblewavelength range, where the visible wavelength is considered to be about400 to about 700 nanometers. In such case, image sensor 58 will need tobe responsive to the selected wavelengths and illuminator 59 must bechosen to excite the corresponding wavelengths.

[0088]FIG. 5 shows the main electrical components of controller 23 whichare contained within controller housing 22. A power supply, in the formof batteries 82, supplies all the power to controller 23. A processor 72coordinates the overall task of scanning, decoding and playing back ofaudio data. Preferably, processor 72 is a low-cost 8-bit or 16-bitmicroprocessor, and most preferably one of the family of 80C51 or itsderivatives manufactured by Intel Corporation and others. Drawer switch42, which is positioned to sense the opening and closing of slidingdrawer 24, is interconnected to processor 72 to act as a power-up andstart-up signal to processor 72 when activated. While deactivation ofdrawer switch 42 does not put processor 72 back into power-down mode,any re-activation of drawer switch 42 while processor 72 is powered ondoes force processor 72 to restart from the beginning.

[0089] A nonvolatile memory 74 provides the means to retain data whenprocessor 72 goes into power-down mode. Two discrete memory areas arelogically allocated within nonvolatile memory 74 for holding audio dataassociated with two particular image prints: an Area B (not shown) tohold audio data associated with the current bottom-most image print 48(see FIG. 3), and an Area T (not shown) to hold audio data associatedwith the current top-most image print 49 (see FIG. 3). Top-most imageprint 49 is the print visible at viewing aperture 26. A random accessmemory (RAM 76 provides temporary working memory for processor 72.Unlike nonvolatile memory 74, the content of random access memory 76 islost when processor 72 goes into power-down mode. A read-only memory(ROM) 77 stores the machine code routines for execution by processor 72,such as the algorithm for decoding encoded data 54.

[0090] Illuminator 59 comprises a bank of light-emitting diodes (LEDs)mounted in close proximity to each other so as to cast a uniformillumination on encoded data 54. Under the control of processor 72,illuminator 59 is activated while image sensor 58 scans an image ofencoded data 54 through scanning window 52. Processor 72 turns offilluminator 59 when not used to conserve batteries 82. Alternatively,illuminator 59 may be any other light emitting devices capable ofilluminating encoded data 54. Image sensor 58 comprises a solid-statesensor and a predetermined lens to attain focus and a substantiallyfull-image view of encoded data 54 along optical paths 60, 61.Preferably, the solid-state sensor is the OV7110 sensor manufactured byOmni Vision Technologies, Inc. of Sunnyvale Calif. The OV7110 is alow-cost monochrome single-chip CMOS sensor with digital output linesthat allow direct external access to video data and has a resolution of644 by 484 pixels. The scanned image of encoded data 54 from imagesensor 58 is stored in random access memory 76 while processor 72decodes encoded data 54.

[0091] A digital signal processor (DSP) 80 comprises a codec(coder/decoder) to compress and decompress audio and ananalog-to-digital/digital-to-analog (A/D-D/A) converter. Preferably, thecodec is a chip-set solution based on Cybit ASC101A low rate audio coderas implemented in the ASM 100 Vocoder Module manufactured by CyberneticsInfoTech, Inc. of Rockville, Md. Cybit ASC101A features high-compressionscalable audio data rates from 0.9 Kbits per second to 2.8 Kbits persecond. These are very low audio bit rates by industry standards. Forexample, telephone quality codec typically operates at 8,000 samples persecond at 8-bit resolution which is equivalent to audio bit rate of 64Kbits per second. As the reader will appreciate, the lower audio bitrate means lower audio quality. Nevertheless, at 2.0 Kbits per second,the ASC101A still achieves a high communication quality with MeanOpinion Score (MOS)=3.2. Mean Opinion Score was developed in thecommunications industry to determine the general acceptability orquality of voice communication systems or products. Evaluators rate theoverall quality of speech/audio samples in a five-category rating scalewith points assigned for each level as follows: 5—Excellent, 413 Good,3—Fair, 2—Poor, and 1 —Bad.

[0092] The A/D-D/A converter is conventionally known and preferably is aTexas Instrument TLC320AD50 chip or equivalent. Decompressed audio datais converted into an analog signal representative of the original audioby the D/A converter. This analog signal then goes to an audio amplifier78 for amplification and then onto loudspeaker 38 for soundreproduction, both of these devices are conventionally known. It shouldbe apparent from these descriptions that other devices capable ofdecompressing audio data can also be used; for example, other integratedcircuit (IC) chips such as the family of TMS320C54X digital signalprocessors manufactured by Texas Instruments are also considered usefulin addition to other numerous multi-IC component design alternativeswhich are conventionally known. It should also be understood that thefunctions of several of these chip sets may also be integrated into asingle chip in the form of custom large scale integration (LSI).Alternatively, the compression/decompression of audio may also beimplemented entirely in a software algorithm to be executed by processor72.

[0093] Having described the main features of print holder 21 andcontroller 23, the factors affecting the audio data capacity will now bedescribed, namely the resolution of image sensor 58, encodement formatoverhead and the audio data rate of digital signal processor 80.

[0094] Using the preferred image sensor 58 referenced above which has aresolution of 644 by 484 pixels, the theoretical maximum capacity ofdata decodable from image sensor 58 is 311,696 bits, or 38,962 bytes,provided that each and every data feature of encoded data 54 is mappedexactly and precisely to a corresponding pixel in image sensor 58 andeach data feature has a binary value. In practice, this idealizedcapacity would not be attainable as every form of encodement mustaccommodate many real-world conditions and also carry overheadinformation necessary for its own identification and decoding. Using thepreferred PaperDisk™ encodement format referenced earlier, some factorsthat reduce the theoretical maximum capacity are: (a) distortions andinaccuracies introduced by the optics of the described system and byimage sensor 58; (b) misalignment between encoded data 54 and the fieldof view of image sensor 58; (c) quantization errors resulting frommapping data features to image sensor pixels especially where there isskew; (d) overhead of built-in error correction codes (ECC) to allow fordata recovery in case of physical damage to encoded data 54; (e)overhead of identification markers in the encodement format tofacilitate decoding, and the like. In practice, the net combined effectof these factors reduces the theoretical capacity by a factor of about10. Hence the theoretical maximum capacity of 38,962 bytes equates to apractical maximum capacity of approximately 3,896 bytes. This capacityrepresents the practical amount of audio data one can encode on the backof an image print using the aforementioned image sensor 58 and thePaperDisk™ encodement format. Based on the data capacity of 3,896 bytes,TABLE 1 shows the relationship between the audio data rate and audiorecording time using the preferred digital signal processor 80referenced earlier. TABLE 1 Audio data rate Audio recording time 0.9Kbits/sec 34 seconds 1.0 Kbits/sec 31 seconds 1.4 Kbits/sec 22 seconds1.8 Kbits/sec 17 seconds 2.0 Kbits/sec 15 seconds 2.4 Kbits/sec 13seconds 2.8 Kbits/sec 11 seconds

[0095] As noted in TABLE 1, if desired, there can be a trade off betweenaudio quality and recording time. Preferably this optimization will bedone automatically by the encoding software described in further detailbelow, whereby the highest audio rate will be automatically selectedwhich meets the desired recording time. Preferably, an audio data rateof 2.0 Kbits/sec (with communication quality Mean Opinion Score of 3.2)or higher will be used, resulting in an audio message length of at leastfifteen seconds per image print.

[0096] Even longer audio recording times can be attained through means(not shown) such as: (a) optimizing the optical components to increaseaccuracy and reduce distortion; (b) using image sensors with higherpixel resolution, for example, using an image sensor of 1024 by 768pixels would represent an increase of two and half times the audiocapacity over preferred image sensor 58 described above; (c) using eachdata feature to represent more than a binary value by using differentlevels of gray or by using different colors with a color image sensor,(d) using both visible and invisible ink or dye to imprint encoded data54 to essentially multiply the data capacity; (e) using multipleencodings at multiple distinct wavelengths to essentially multiply theencoded data capacity, for example, putting one encoded data in red andanother encoded data in green, and using an appropriate filter to readeach of the encoded data; (f) using other encodement format offeringhigher density and capacity; (g) using other codec with highercompression at a higher MOS, and the like.

[0097] Operation of First Preferred Embodiment—FIGS. 1 to 6.

[0098] The operation of print holder 21 will be described first byreference to FIGS. 1 to 3. Print holder 21 is first prepared for use byloading a vertically arranged stack of image prints 36 into slidingdrawer 24 which are supported therein by front wall 30, side walls 28,floor 32 and separator bar 41. Assume for the present description thatback surface 46 of each image print is imprinted with encoded data 54representing human speech. Sliding drawer 24, loaded with image prints36 is then pushed into frame housing 20 through slot 34 as per arrow 50.Print holder 21 is now ready to successively display, one at a time, thestack of image prints 36 within sliding drawer 24 at viewing aperture 26as follows:

[0099] When sliding drawer 24 is disengaged or pulled away from framehousing 20 until stopped by the stop members (not shown) describedearlier, the bottom-most image print 48 of stack 36 is separated byseparator bar 41 from the remainder of stack 36. The separated imageprint is retained within frame housing 20 and guided toward viewingaperture 26 where it is centered for display while the remainder ofstack 36 remains intact within the sliding drawer 24 against theseparator bar 41. Engaging or pushing sliding drawer 24 back into framehousing 20, as per arrow 50, now causes the displayed print to berepositioned to the top of stack 36, while it is still centered againstviewing aperture 26. To summarize, during each complete cycle ofdisengagement and engagement of sliding drawer 24 within frame housing20, that is, pulling sliding drawer 24 out fully away from frame housing20 and sliding it back fully into frame housing 20 again, one imageprint is removed from the bottom end of stack 36 and returned to the topend of stack 36. For simplicity, henceforward, the pulling of slidingdrawer 24 away from frame housing 20 until stopped by the stop membersshall be referred to as full “pull-out”, the pushing of sliding drawer24 into frame housing 20 until fully engaged shall be referred to as afull “push-in”, and the combination of the two actions in sequence shallbe referred to as a full “pull-out/push-in”. Additional details relatingto the structure of the described device and particularly the printadvancement features including the separating and retaining means, aredescribed in greater detail in the previously referenced U.S. Pat. No.4,939,860, issued to P. Ackeret on Jul. 10, 1990 and assigned toLicinvist, A G.

[0100] Print holder 21 described above and in greater detail in thecross referenced patent provides a convenient means for retaining astack of image prints and for sequentially advancing each print in thestack for viewing. It will be appreciated from the discussion thatfollows, however, that other devices capable of retaining and advancingprints ire also useful for the present invention herein described andcan be substituted for the particularly described structure.

[0101] The operation of display apparatus 18 in its totality can now bedescribed by referring to FIGS. 1 to 6, and in particular the logic flowdiagram of FIG. 6. All memory areas referenced in FIG. 6 reside innonvolatile memory 74 so a power-down does not cause loss of data.

[0102] Controller 23 is normally in the power-down mode to conservebatteries 82. Upon a user opening sliding drawer 24, drawer switch 42 isactivated and starts up processor 72. Processor 72 waits for slidingdrawer 24 to be closed again deactivating drawer switch 42. The durationof time that drawer switch 42 is activated is measured by processor 72and is related to two operational modes of display apparatus 18: first,playing back the audio data associated with image print 49 shown atviewing aperture 26 without causing an advancement of image prints 36,and second, advancing image prints 36 and then playing back the audiodata of the newly shown image print 49 under viewing aperture 26.

[0103] To play back the audio data associated with image print 49 shownat viewing aperture 26, the user pulls out sliding drawer 24 onlypartially, just sufficiently to activate drawer switch 42 followed by animmediate pushing in of sliding drawer 24. Due to the inherent design ofprint holder 21, this partial opening and closing of sliding drawer 24activates drawer switch 42 only momentarily, preferably less than onesecond, and does not cause an advancement of an image print.

[0104] To advance the image print and play back the audio data of thenewly shown image print 49 under viewing aperture 26, the user performsa full pull-out/push-in of sliding drawer 24. The full pull-out/push-inaction required to advance an image print inherently takes longer thanthe above-described partial in/out movement of sliding drawer 24,preferably longer than one second.

[0105] First, in the partial in/out movement of sliding drawer 24, whendrawer switch 42 is activated for less than one second, processor 72checks Area T in nonvolatile memory 74 for audio data correspondingtop-most image print 49 under viewing aperture 26. If found, processor72 sends this audio data to digital signal processor 80 for audioplayback. If no data is found, no task is executed. In either case, oncecomplete, processor 72 goes into a power-down mode.

[0106] Second, when drawer switch 42 is activated for one second or moreduring a full pull-out/push-in of sliding drawer 24, and bottom-mostimage print 48 of stack 36 is moved to become top-most image 49 of stack36 under the viewing aperture 26, processor 72 moves any audio datafound at Area B to Area T in order to maintain the correctcorrespondence between top-most image print 49 under the viewingaperture 26 and its associated audio data. Since image sensor 58 alwaysscans encoded data 54 from bottom-most image print 48 while the top-mostimage print 49 is what is shown under the viewing aperture 26, processor72 must move audio data from Area B to Area T to maintainsynchronization whenever an image print is advanced. Processor 72 thenturns on illuminator 59 and image sensor 58 performs an image scan ofencoded data 54 seen through scanning window 52. The scanned image isdecoded by processor 72 and the resultant audio data is stored in AreaB; this audio data is not to be played back immediately because itbelongs to bottom-most image print 48 of stack 36. Processor 72 thenchecks Area T for audio data belonging to top-most image print 49 thatis currently under viewing aperture 26. If audio data is found at AreaT, processor 72 sends it to digital signal processor 80 for audioplayback. If not, no task is executed. In either case, once complete,processor 72 goes into power-down mode.

[0107] In the above description, the mode of operation was determinedfrom the duration of drawer switch 42 activation. Alternatively, asecond switch (not shown) located at the stop member (referenced underFIG. 1 but not shown) can be used. This second switch is activated onlywhen sliding drawer 24 is fully disengaged from frame housing 20.Activation of both the second switch and drawer switch 42 would indicatethat the user has advanced to the next image print. Still other methodsof sensing the mode of operation are possible, including but not limitedto optical, magnetic, voice recognition and the like.

[0108]FIG. 6 describes the process of playing back of audio data whichare already encoded on back surface 46 of the image prints. Next thesteps for audio recording and imprinting encoded data 54 on the imageprints will be described. Additional equipment and software required forthe following steps are described but not shown in figures.

[0109] For audio recording, a microphone-equipped computer, a printerand a predetermined audio recording and encoding software will berequired. Audio recording software is preferably based on the audiocompression algorithm from Cybernetics InfoTech, Inc. of Rockville, Md.referenced earlier. Cybernetics supplies such algorithms in ANSI C code,16-bit fixed-point C code or Windows 95/NT DLL (dynamic link libraries).Preferably, the audio recording software automatically selects thehighest audio data rate that will accommodate the duration of theparticular audio recording, hence optimizing the audio quality. Encodingthe audio data is preferably based on the PaperDisk™ software fromCobblestone Software, Inc., of Lexington, Mass. referenced earlier. ThePaperDisk™ software is for PC compatible, 386 or above, and Windows 3.1or Windows 95.

[0110] As described earlier with respect to FIG. 4, the imprintingprocess may be accomplished by the user with a computer, a printer and apredetermined software, or by the photo finishing laboratory as a stepin the photo finishing process. If the imprinting is done by the user,briefly the steps are as follow for each image print using thepredetermined software described above: (a) enter into the computer anytextual information desired on the image print, (b) record through thecomputer microphone an audio message desired for the image print, (c)place the corresponding image print into the printer and activate theprinting for imprinting encoded data 54 on its back surface. FIG. 4shows an example of a typical output. Imprinting directly on backsurface 46 of an image print is preferably done using a resin inkthermal transfer printer technology such as Alps MicroDry™ MD-2010printer manufactured by Alps Electric (USA), Inc. of San Jose, Calif. Asan alternative to imprinting directly, encoded data 54 may be imprintedfirst on an adhesive label using a laser printer or inkjet printer. Thelabel can then be affixed to back surface 46 of an image print.

[0111] If the imprinting is to be done as a step in the photo finishingprocess of the photographic print by the photo finishing laboratory, thephoto finishing laboratory will require the user to send in data that isrepresentative of the human readable information and the audio datatogether with the picture image data. Briefly the steps are as follow:(a) enter into the computer any textual information desired on the imageprint, (b) record into the computer through the microphone an audiomessage desired for the image print, (c) send the text data, audio dataand image data specific to each image print to the photo finishinglaboratory. These data may be transported either physically through theuse of traditional storage media such as magnetic media, optical media,solid-state memory device and the like, or electronically through use ofemail, FTP or Internet and the like. This approach to imprinting encodeddata 54 is particularly applicable when a digital camera is used fortaking the original picture. There is also little equipment or softwarerequired by the photo finishing laboratory to provide such imprintingservice to customers.

[0112] Description of a Further Preferred Embodiment—FIGS. 7 to 10

[0113] A further preferred embodiment of the present invention will nowbe described in detail. This further preferred embodiment incorporatesall of the features of the first preferred embodiment plus additionalfeatures that permit audio recording with display apparatus 18, featuresfor associating audio recording to the image print, and features fortransferring audio data to an external device for imprinting of encodeddata 54.

[0114]FIG. 7 shows the above-described additional components attached toexterior supporting surface 40 of controller housing 22, namely amicrophone 90, a record switch 92 for activating audio recording, atransceiver 94 for wireless communication with external devices (notshown), and a data connector 96 for wired communication with externaldevices (not shown). Transceiver 94 preferably utilizes the industrystandard IrDA (infrared data association) serial protocol technology.Data connector 96 provides for a wired connection to external devices,preferably via a serial interface.

[0115]FIG. 8 shows an exemplary layout of back surface 46 of an imageprint representing the first step in the annotation process of thisfurther preferred embodiment. A unique picture identification marking(“PID”) 100 designated by the user is handwritten on back surface 46 ofan image print. Preferably, PID 100 is limited to a three-characteralphanumeric writing for ease of decoding by processor 72. PID 100 isplaced on back surface 46 of an image print in a location where it willbe substantially centered within scanning window 52 when the image printis the bottom-most image print 48 at the bottom of sliding drawer 24,and sliding drawer 24 is fully engaged within frame housing 20.Preferably PID 100 is easily removable as it serves only to temporarilyassociate an image print to its corresponding audio data during theannotation process and will not be required after the imprinting ofencoded data 54. A number of marking apparatuses exist on the marketwhich can be easily erased. One example is the Erasemate™ Penmanufactured by PaperMate™ in which the ink from the pen can be erasedas easily as pencil marks. Alternatively, PID 100 may be handwritten ona removable adhesive label and affixed to back surface 46 of an imageprint. The label could then be removed prior to imprinting of encodeddata 54.

[0116]FIG. 9 shows the additional electrical components of controller 23in the further preferred embodiment of the present invention, namelymicrophone 90, which is preferably a subminiature type which isconventionally known, record switch 92 for activating audio recording,transceiver 94 for wireless communication with external devices (notshown), and data connector 96 for wired communication with externaldevices (not shown). Analog signals from microphone 90 are firstconverted into digital format by the A/D function of digital signalprocessor 80 and then compressed into audio data by the codec functionof digital signal processor 80. Transceiver 94 preferably utilizes theindustry standard IrDA (infrared data association) serial protocoltechnology, or alternatively may comprise a RF transmitter and receiverpair, or other well known wireless communication devices and protocols.Data connector 96 provides for a wired connection to external devices,preferably via a serial interface, but may also be parallel or any othersuitable input-output interface to effect digital data transfer.

[0117] Nonvolatile memory 74 has additional memory allocation beyondthat described in the first preferred embodiment above. A discretestorage area is logically allocated within nonvolatile memory 74 to holdcatalog (not shown) information. The catalog is a list of entriesconsisting of two fields: the PID 100 and a PID address (not shown). ThePID address points to an area in nonvolatile memory 74 for storing audiodata corresponding to PID 100. The catalog can be implemented on aperpetual first-in first-out (FIFO) basis by keeping a predeterminednumber of the most current PID 100 entries.

[0118] Processor 72 has additional functions of decoding handwriting andsynthesizing speech. The function of decoding handwriting is performedthrough a process commonly known as Optical Character Recognition (OCR),and more specifically, handwriting recognition (HWR). Algorithms forhandwriting recognition are available from a number of commercialsources. The applicant has found the Allegro handwriting recognitionsystem from Fonix Corporation of Salt Lake City, Utah to be particularlyuseful. Such an algorithm is incorporated into read-only memory 77.Preferably PID 100 is limited to a three-character alphanumeric writingfor ease of decoding. Alternatively, PID 100 may contain a variablelength of alphanumeric characters for increased versatility. Thefunction of synthesizing speech is performed through an algorithm calledtext-to-speech whereby input in the form of text data is synthesizedinto human recognizable speech. There are many commercially availabletext-to-speech algorithms on the market and are conventionally known tothose skilled in the art. Such an algorithm is also incorporated intoread-only memory 77.

[0119] Operation of a Further Preferred Embodiment—FIGS. 10A to 10B

[0120] The further preferred embodiment of the present inventionincorporates all of the functions of the first preferred embodiment plusadditional functions of audio recording, associating audio recording tothe image print, and transferring audio data to external devices forimprinting of encoded data 54. In this further preferred embodiment,audio recording can be done directly using display apparatus 18, whereasin the first preferred embodiment, the annotation procedure required theuse of a separate computer to conduct the audio recording. Hence, thisfurther preferred embodiment has the advantage that audio recording canbe done anywhere. A computer and a printer are needed only at the timeof imprinting encoded data 54 on the image prints.

[0121] Audio recording using display apparatus 18 will be describedfirst followed by the imprinting of encoded data 54 on the image prints.

[0122]FIGS. 10A and 10B are the logical flow diagrams of this furtherpreferred embodiment. A comparison will show that the logic flow forthis further preferred embodiment is an extension of the first preferredembodiment logic flow with the addition of two routines: a routine 110to process PID 100 information and a routine 112 to perform audiorecording. Other processes are the same as in the first preferredembodiment. The two additional routines 110 and 112 will now bedescribed. All memory areas referenced in FIG. 10 reside in nonvolatilememory 74 so a power-down does not cause loss of data.

[0123] Prior to loading the stack of image prints 36 into displayapparatus 18, the user places a unique handwritten PID 100 on backsurface 46 of each image print. These unique PID 100 are used by thepresent invention to associate audio recording with each image print.PID 100 is written on the image print in a location where it will besubstantially centered within scanning window 52 when the image print isthe bottom-most image print 48 in sliding drawer 24, and sliding drawer24 is fully engaged within frame housing 20. Preferably PID 100 islimited to a three-character alphanumeric writing, and is easilyremovable after use.

[0124] Assume now that the stack of image prints 36 described above havebeen loaded into sliding drawer 24. Referring to FIG. 10A, the entrypoint to routine 110 starts when the decoded data is found to containPID 100. PID 100 of the bottom-most image print 48 will not be found inthe Catalog since this was the start of the new stack of image prints36. Therefore, an entry will be added to the catalog containing this PID100 and its corresponding PID address. The PID 100 itself is also storedin Area B of nonvolatile memory 74. To understand and follow whathappens next, consider that the bottom-most image print 48 is nowadvanced to become the top-most image print 49. As this occurs, thecontent of Area B is moved to Area T. Referring now to FIG. 10B, theentry point to routine 112 starts when the content of Area T is found tocontain PID 100. PID 100 from Area T is announced through loudspeaker 38so the user has an audio confirmation of the identity of top-most imageprint 49 currently shown under viewing aperture 26. The announcement isin the form of synthesized speech generated by the text-to-speechalgorithm and the digital signal processor 80. Each alphanumericcharacter is announced one at a time such as “double-u . . . two . . .seven” using the example of PID 100 shown in FIG. 8. Processor 72 waitsfor the user to activate record switch 92 to do an audio recording fortop-most image print 49. For the duration that record switch 92 isactivated, processor 72 stores audio data at the PID addresscorresponding to PID 100, and also into Area T. Upon deactivation ofrecord switch 92, processor 72 plays back the stored audio data fromArea T through loudspeaker 38 for user verification. If, after the audioreplay, the user is dissatisfied, a new recording can be made bydepressing record switch 92 again and repeating the process. There is atime-out feature whereby if record switch 92 remains idle or notactivated for a predetermined time, preferably after thirty seconds, itwill be assumed that the user does not want to make or further modify arecording, then processor 72 goes into power-down mode. As can beobserved from routine 112, once record switch 92 has timed out, there isno provision to modify an existing audio recording. Such a provision hasbeen omitted from the flow diagrams for simplicity. Other alternativemodes of starting and stopping recording are also possible. For example,activating record switch 92 may give the user a fixed time duration inwhich to make an audio recording, or audio recording may be started byactivating record switch 92 once, and stopped by activating recordswitch 92 once again.

[0125] The above description refers to the situation where PID 100 didnot initially exist in the catalog. When PID 100 already exists in thecatalog (referring back to FIG. 10A routine 110), processor 72 checks tosee if the corresponding PID address for PID 100 contains audio data. Ifaudio data is found, it means the user had previously made an audiorecording for this image print, so processor 72 copies this audio datato Area B. The remaining steps in the logic flow diagram show the playback of this audio data when this image print is advanced to thetop-most image print 49 of the stack 36. If no audio data is found, itmeans the user has not yet made an audio recording for this image print,so processor 72 stores PID 100 in the Area B, and the user will be givenan opportunity to make an audio recording for this image print in thesame manner as described before.

[0126] After completing the above-described process for each image printin stack 36, each image print will have an associated audio recordingstored in nonvolatile memory 74 of display apparatus 18. The next stepof imprinting encoded data 54 on back surface 46 of the image printswill now be described.

[0127] Preferably, transceiver 94 communicates through wireless means totransfer PIDs 100 and their associated audio data from nonvolatilememory 74 of display apparatus 18 to a computer, eliminating the needfor a physical link. Where a wireless link is not available, dataconnector 96 is used to transfer the data by wired means. Data transferis initiated by activating predetermined software on the computer. OncePIDs 100 and their associated audio data have been transferred to thecomputer, the remaining imprinting process is the same as that describedabove with respect to the first preferred embodiment. The only exceptionis that just prior to putting the image print into the printer forimprinting encoded data 54, PID 100 is removed as it is no longer neededonce the associated audio data is encoded on back surface 46 of theimage print.

[0128] In routine 112 of FIG. 10B, digital signal processor 80preferably uses the highest audio data rate for audio recording. Then,prior to the imprinting of encoded data 54 on the back surface 46 of theimage print, the software on the computer selects the highest audio datarate that will accommodate the duration of the associated audiorecording so as to maximize the audio quality of encoded data 54.

[0129] While PID 100 is a temporary marking to serve the end purpose ofimprinting encoded data 54 on the correct corresponding image print, auser may choose to operate display apparatus 18 using PID 100indefinitely without ever imprinting encoded data 54 on the imageprints. Such usage is limited only by the amount of audio recordingstorage capacity of nonvolatile memory 74.

[0130] Additional Preferred Embodiments

[0131] Additional preferred embodiments are described below but are notshown in the accompanying figures.

[0132] In another preferred embodiment, controller housing 22 withcontroller 23 parts housed therein is detachably mounted to framehousing 20. When controller housing 22 is separated from frame housing20, this self-contained controller 23 can scan and playback encoded data54 from photographic prints even if the prints are stored inside photoalbums, provided that back surface 46 of the photographic prints arevisibly accessible to the optical components of controller 23. In thisembodiment, controller 23 is held against back surface 46 of aphotographic print, a playback switch (not shown) is activated causingcontroller 23 to scan an image, decode encoded data 54, and then playback the decoded audio data. This embodiment of the present inventionhas broad application beyond image prints and associated audiorecording, such as transferring non-audio data from printed sheets to anelectronic hand-held device.

[0133] In still another preferred embodiment, nonvolatile memory 74 isdetachably mounted to controller 23 so that it may then be physicallyremoved from controller housing 22 and inserted into a computer or otherimprinting device to effect the transfer of data to the computer. Thisalso has the advantage of allowing a large number of annotations to becompleted at one time by simply detaching nonvolatile memory element 74whenever it becomes “full” and replacing it with another nonvolatilememory element 74 to continue the annotation with other image prints.

[0134] In yet another embodiment, encoded data 54 may contain text datainstead of audio data, whereby such text data is played back assynthesized speech through text-to-speech conversion. This arrangementhas the advantage of allowing a longer audio playback than is possiblethrough the digitization of human speech. This embodiment has many broadapplications, such as for example in children's story books whereby along narrative story may accompany each picture card, or it may act as areading device for the visually impaired.

[0135] In another embodiment, the function of the computer and printeris replaced by a self-contained standalone device capable of: (a) audiorecording or receiving digital audio data from display apparatus 18, (b)digitizing and compressing the recorded audio into audio data, (c)taking in an image print from an input tray, imprinting encoded data 54onto back surface 46 of the image print and transporting it to an outputtray. Such a self-contained device has the advantage of compactness.

[0136] Still other preferred embodiments are described below which usedifferent materials for the viewing aperture. New materials aredescribed below but are not shown in the figures.

[0137] In one further preferred embodiment, the viewing aperture 26 ismade of a clear or transparent touch sensitive screen material (notshown). Preferably the touch screen is based on the analog resistivetype technology allowing finger, gloved hand or stylus activation. Touchscreen technology is conventionally known to those skilled in the art.The electrical output of the touch screen is connected to processor 72and processed as user input information. In this arrangement, encodeddata 54 on each image print conveniently comprises machine instruction,text data and the like, relevant to the respective image print. Thus,when an image print is advanced to viewing aperture 26, the machineinstruction contained within encoded data 54 is executed in conjunctionwith user input from the touch screen. In operation, therefore, a usercan interact with display apparatus 18 by means of activating specificareas of the touch screen corresponding to the information visiblethrough viewing aperture 26. For example, when used as a child'slearning aid, an image print may contain pictures of several differentanimals. Encoded data 54 for that image print will contain pertinentinformation relating to the location of each animal on the image print.When a user presses the area of the touch screen corresponding to aparticular animal as indicated by encoded data 54, display apparatus 18plays back the name of the animal through speech synthesis such as:“This is a tiger.” When the user advances to the next image print,different animals are shown and encoded data 54 corresponding to the newimage print is read and stored. Hence different messages are played backwhen different areas on the touch screen are activated. Alternatively,the display apparatus may ask the user: “Where is the tiger?”, to whichthe user is expected to touch that area of the touch screen where thetiger is seen. In another example of a use of the present invention as achild's learning aid, each image print may contain letters of thealphabet. The user is instructed to hand trace the letter shown using astylus on the touch screen. The hand tracing is then analyzed byprocessor 72 by means of handwriting recognition or simple patternmatching algorithms. A congratulatory message is played back to the userif the tracing was done correctly.

[0138] In another preferred embodiment, viewing aperture 26 is made ofliquid crystal display (LCD) material (not shown). Preferably the LCD isa transmissive type allowing light to pass through the LCD, hence imageson the LCD appear as an overlay to the image print visible under viewingaperture 26. For increased visibility, a light source (not shown) may belocated directly beneath viewing aperture 26 to provide illumination tothe front surface of the image print. Transmissive LCD technology isconventionally known to those skilled in the art. The LCD iselectrically connected to processor 72 and serves to provide dynamicallychangeable visual information to the user. Encoded data 54 on each imageprint comprises machine instruction, text data and the like, relevant tothe respective image print. Thus, when an image print is advanced toviewing aperture 26, the machine instruction contained therein isexecuted and information is displayed on the LCD accordingly. Inoperation, when a user advances an image print to viewing aperture 26,processor 72 plays back audio information through loudspeaker 38 andvisual information through the LCD display. The visual information onthe LCD may also create an animation effect by means of activatingsuccessive areas of the LCD screen against the static background pictureof the image print. For example, when used as a child's story book, aboy may be represented by a simple stick-figure displayed on the LCDagainst the background picture of buildings. Processor 72 plays back thestory lines through speech synthesis such as: “See Johnny leave hishouse. See Johnny walk by grandma's house. See Johnny go to theschool.”; while successively activating the areas of the LCDcorresponding to where Johnny is according to the narration, hencecreating an animation effect of Johnny walking from his home to hisschool. When the user advances to the next image print, differentpicture and story lines are read from encoded data 54 and then playedback as described above.

[0139] In yet another preferred embodiment, the features of the touchscreen and the LCD described above are simultaneously incorporated intodisplay apparatus 18. The result is an interactive display apparatusthat can both accept user input information and output information tothe user. For example, when used as a child's question and answerresponse tool, the user may be asked to select all the objects shown onan image print that belong in the kitchen, such as pots and pans. As theuser selects each correct object through the touch screen, a check markappears on the LCD corresponding to where the object is located on theimage. When all the objects have been selected correctly, acongratulatory message is played back to the user. Furthermore, the userresponses may be stored in nonvolatile memory 74 and output to anexternal device such as a computer for record keeping of the correctresponses. This data may be transferred either through the use of dataconnector 96 or transceiver 94.

[0140] Description of a Second Further Preferred Embodiment—FIGS. 11A to11D and 12.

[0141] In this preferred embodiment, the function of imprinting themachine-readable data on the back surface of the image print isincorporated within display apparatus 18, thus eliminating the need fora separate computer and printer as in previous embodiments. This secondfurther preferred embodiment is thus capable of: (a) recording audio,(b) converting the recorded audio into machine-readable data, and (c)imprinting the machine-readable data onto the back surface of the imageprint in the form of encoded data 54, using an imprinter disposed withindisplay apparatus 18. Also, whereas previously the process of recordingaudio and the process of imprinting were batched, in this preferredembodiment, these steps are performed sequentially, with each audiorecording followed immediately by imprinting the corresponding imageprint. Hence the previously required process of first handwriting PIDs100 on the back surface 46 of each image print is no longer necessary.

[0142] Referring to FIGS. 11A to 11D, four different configurations ofthis preferred embodiment are shown. This preferred embodimentincorporates all of the parts and functions from the FURTHER PREFERREDEMBODIMENT described above and shown in FIGS. 7 to 10, with the furtheraddition of a micro printer 115 (see for example, FIG. 11D) for printingencoded data 54. For each of the four configurations, micro printer 115is disposed in a different location within display apparatus 18. Microprinter 115 is characterized by ultra compactness, lightweight and lowpower consumption, well suited for portable battery-operated usage.Examples of such micro printers can be found from manufacturers such asAlps Electric Co., Ltd., Seiko Instruments Inc., Epson America, Inc.,and Fujicopian Co., Ltd. Referring to FIG. 12, micro printer 115 isconnected to processor 72 to receive machine-readable data forimprinting. ROM 77 includes additional software routines to convertaudio data into machine-readable data and then send thismachine-readable data to micro printer 115 for imprinting as encodeddata 54.

[0143] In FIG. 11A, micro printer 115 (not shown in FIG. 11A) is locatedwithin frame housing 20 of display apparatus 18. An input slot 124 islocated on the front surface of frame housing 20 and an output slot (notshown) is located opposite input slot 124 on the back surface of framehousing 20.

[0144] In FIG. 11B, the back side of display apparatus 18 is shown.Micro printer 115 (not shown in FIG. 11B) is located within controllerhousing 22. In this configuration, input slot 124 is located on theright side of controller housing 22, while an output slot 126 is locatedon the left side when viewed facing the back of display apparatus 18 asshown in FIG. 11B.

[0145] In FIG. 11C, micro printer 115 (not shown in FIG. 11C) is locatedin a sliding drawer handle portion 120 of sliding drawer 24. On theoutward facing side of sliding drawer handle 120, there is an input slot124, while an output slot (not shown) is located on the inward facingside of sliding drawer handle 120, directly opposite input slot 124.

[0146] In FIG. 11D, micro printer 115 is shown to be located on theseparator bar (not shown in FIG. 11D) of sliding drawer 24. In thisconfiguration, during the closing of sliding drawer 24, the print head(not shown) of micro printer 115 passes directly over the back surface46 of image print 130 that is shown through viewing aperture 26.Imprinting of encoded data 54 can be accomplished directly onto backsurface 46 of image print 130 by micro printer 115 during the closing ofsliding drawer 24. Alternatively, instead of imprinting directly on backsurface 46, it is also possible to first imprint a label with encodeddata 54, and during the closing of sliding drawer 24, micro printer 115applies the label to back surface 46 of image print 130.

[0147] Operation of Second Further Preferred Embodiment—FIGS. 11A to 11Dand 12

[0148] The operation of the four configurations of the second furtherpreferred embodiment of the invention will now be described referring toFIGS. 11A-11D. In all configurations, the user starts by making an audiorecording corresponding to the image print shown through viewingaperture 26 using the recording functions of display apparatus 18. Theaudio recording procedure is similar to the operation previouslydescribed in OPERATION OF A FURTHER PREFERRED EMBODIMENT— FIGS. 10A to10B. In this case, however, it is not necessary to first handwrite PIDs100 on the back of each image print since imprinting of themachine-readable data on the image prints takes place immediatelyfollowing the making of each audio recording.

[0149] For the configuration shown in FIG. 11A, the user starts bymaking an audio recording for the image print 130, which is shown inviewing aperture 26. Once the recording has been made, the user fullyopens sliding drawer 24 and removes image print 130 from the stack ofimage prints 36 in sliding drawer 24. The user then fully closes slidingdrawer 24 and inserts image print 130 into input slot 124 with the imageside facing up. Image print 130 is drawn in through input slot 124 bythe paper feeding mechanism (not shown) of micro printer 115 in thedirection shown by arrow 132, while the machine-readable data, in theform of encoded data 54, is imprinted on the back surface 46 of imageprint 130 by micro printer 115. The imprinted image print 130 is thenretrieved from the output slot located on the back of display apparatus18. Image print 130 now has machine-readable data encoded on its backsurface 46 in the form of encoded data 54, and may be placed back intosliding drawer 24 immediately or later. This process is repeated foreach of the image prints to be annotated and imprinted withmachine-readable data. In an alternative mode of operation, the userfirst fully opens sliding drawer 24, removes the entire stack of imageprints 36, and then fully closes sliding drawer 24. The user thenselects one of the image prints 130 and uses display apparatus 18 tomake an audio recording associated with this image print. When satisfiedwith the recording, the user inserts image print 130 into input slot 124and retrieves the imprinted image print from the output slot. The userthen repeats this process for each of the image prints to be annotatedand imprinted with encoded data 54. When all of the image prints havebeen annotated and imprinted, the user opens sliding drawer 24, returnsthe stack of image prints 36, and fully closes sliding drawer 24.

[0150] For configuration shown in FIG. 11B, the operation is identicalto the operation of the configuration described above and shown in FIG.11A. Image print 130 is inserted into input slot 124 with the image sidefacing up. Image print 130 is drawn in through input slot 124 by thepaper feeding mechanism (not shown) of micro printer 115 in thedirection shown by arrow 132, while the machine-readable data, in theform of encoded data 54, is imprinted on the back surface 46 of imageprint 130 by micro printer 115. The imprinted image print 130 is thenretrieved from output slot 126.

[0151] For the configuration shown in FIG. 11C, the user starts bymaking an audio recording for image print 130, which is shown in theviewing aperture 26. Once the recording has been made, the user fullyopens sliding drawer 24 and removes image print 130 from the stack ofimage prints 36. The user inserts image print 130 with image side facingup into input slot 124 located on the outside surface of sliding drawerhandle 120. Image print 130 is drawn in by the paper feeding mechanism(not shown) of micro printer 115 in the direction shown by arrow 132,while the machine-readable data, in the form of encoded data 54, isimprinted on the back surface 46 of image print 130 by micro printer115. Image print 130 is then fed through the output slot (not shown),whereby the imprinted image print 130 is deposited to the top of thestack of image prints 36 in sliding drawer 24. Image print 130 now hasmachine-readable data imprinted on its back surface 46 in the form ofencoded data 54. The sliding drawer may now be closed and this processcan be repeated. In an alternative mode of operation, the user firstfully opens sliding drawer 24, removes the entire stack 36 of imageprints and leaves sliding drawer 24 fully open. The user then selectsone of the image prints 130 and uses display apparatus 18 to make anaudio recording associated with this image print. When satisfied withthe recording, the user inserts image print 130 into input slot 124 forimprinting. Following imprinting, image print 130 is output through theoutput slot and deposited within sliding drawer 24. The user repeatsthis process for each image print, all the while keeping sliding drawer24 fully open. When all of the image prints have been annotated andimprinted, the stack of image prints 36 will be conveniently locatedback within sliding drawer 24. The user may then close sliding drawer24.

[0152] For the configuration shown in FIG. 11D, the user starts by firstfully opening sliding drawer 24. While sliding drawer 24 is fully open,the user makes an audio recording for image print 130 shown in viewingaperture 26. Once the recording is made, the user closes sliding drawer24. During the closing of sliding drawer 24, the print head of microprinter 115, which is located on the separator bar (not shown in FIG.11D), passes directly over the back surface 46 of image print 130 shownin the viewing aperture 26 in the direction shown by arrow 133 andimprints the machine-readable data onto the back surface 46 of imageprint 130, in the form of encoded data 54. Hence, unlike previousconfigurations described, in this configuration, the encoded data 54 isimprinted on the back surface 46 of image print 130 without firstrequiring the removal of image print 130 from display apparatus 18 forfeeding into micro printer 115. Alternatively, instead of imprintingdirectly on back surface 46, it is also possible to first imprint alabel with the machine-readable data, and during the closing of slidingdrawer 24, micro printer 115 applies the label to back surface 46 ofimage print 130.

[0153] Likewise for the other configurations discussed, while directprinting is desirable for imprinting the machine-readable data, it isalso possible to first print on a label and then have the printermechanism apply the label to the back surface of the image print or inthe alternative, one may apply the label manually. Also, the microprinter may be designed to be installed as an optional add-on to thedisplay apparatus to be conveniently purchased by customers at a latertime. Moreover, while four configurations and possible locations formicro printer 115 have been shown and discussed, those skilled in theart will readily appreciate that other configurations are possible,which configurations are all intended to fall within the scope of theinvention as set out in the appended claims.

[0154] In summary, the ability of the present invention to imprintmachine-readable data, in the form of encoded data 54, without requiringa separate computer and printer is both convenient and time saving. Thisadditional function, in combination with the display and storagefunctions of display apparatus 18, results in a self-containedannotation and display apparatus that is also portable andbattery-operated.

[0155] Description of a Third Further Preferred Embodiment

[0156] In this preferred embodiment, a method for capturing audiocorresponding to an image at the time of capturing the image and forlater playback is described. The method includes using a camera capableof making an audio recording, converting the audio recoding intomachine-readable data, imprinting the machine-readable data onto thecorresponding developed image print, and then playing back the imprintedimage print in the display apparatus. For this method, the displayapparatus of the FIRST PREFERRED EMBODIMENT or the FURTHER PREFERREDEMBODIMENT may be used.

[0157] A camera having audio recording capability is conventionallyknown, be it a single-use film camera, a conventional film camera, aninstant film camera or a digital camera. In a typical camera capable ofmaking an audio recording corresponding to a photographic exposure, anaudio recording can be made before, during or after making the exposure.Audio recording is typically initiated by the user by means ofactivating an audio recording switch on the camera. Audio recordingsmade by these cameras can be stored in a variety of mediums such asoptically, for example, on the film negative itself, magnetically, forexample, on the magnetically coated film negative, or in a solid-statemedium. It is also known in the prior art to affix solid-state audiostorage medium onto the film cartridge or film canister itself forincreased capacity and to avoid loss or separation between the imagesand the audio recordings. Each of these elements are conventional known,hence details not relating specifically to the understanding of thepresent invention have been omitted. The method of the present inventionwill now be described, first in the case of a single-use film camera,then in the case of a conventional film camera, and lastly in the caseof a digital camera.

[0158] Single-Use Film Camera:

[0159] A suitable corresponding audio recording is made as eachphotographic exposure is taken. Once all the film has been exposed, theentire single-use camera is typically taken to a suitably equipped photodeveloper for developing and printing. The photo developer retrieves allof the audio recordings and develops the film negatives in aconventional manner, producing a set of image prints. The photodeveloper then converts the audio recordings into machine-readable dataand imprints the data on the back surface of each corresponding imageprint in the form of encoded data 54. The set of image prints, nowbearing the corresponding audio recordings in the form of encoded data54 printed on their back surfaces, is returned to the customer. Thecustomer places the image prints into display apparatus 18 and is ableto listen to the corresponding audio recordings while viewing each imageprint.

[0160] Conventional Film Camera:

[0161] A suitable corresponding audio recording is made as eachphotographic exposure is taken. Once all the film has been exposed, thefilm cartridge, along with the integrated audio recordings, is returnedto a suitably equipped photo developer for developing and printing. Thephoto developer retrieves all of the audio recordings and develops thefilm negatives in a conventional manner, producing a set of imageprints. The photo developer then converts the audio recordings intomachine-readable data and imprints the data on the back surface of eachcorresponding image print in the form of encoded data 54. The set ofimage prints, now bearing the corresponding audio recordings in the formof encoded data 54 printed on their back surfaces, is returned to thecustomer. The customer places the image prints into display apparatus 18and is able to listen to the corresponding audio recordings whileviewing each image print.

[0162] Digital Camera:

[0163] A suitable corresponding audio recording is made as each image iscaptured. Once a desired number of images and corresponding audiorecordings have been captured, the user takes the image and audio filesto a suitably equipped photo developer. In the alternative, the filescan be transferred over the Internet to an on-line developer or taken toa retail photographic kiosk equipped to read such files directly fromthe particular storage medium used. The image and audio files can bestored and transferred individually, for example, as JPEG and WAV filesrespectively, or each image and its corresponding audio message can becombined into a single audio-image file format such as SoundPix™,developed by SoundPix, Inc. of Incline Village, Nev. The photo developerproduces a set of image prints from the image files and converts theaudio recordings into machine-readable data. The developer then imprintsthe machine-readable data on the back surface of each correspondingimage print in the form of encoded data 54. The set of image prints, nowbearing the corresponding audio recordings in the form of encoded data54 printed on their back surfaces, is returned to the customer. Thecustomer places the image prints into display apparatus 18 and is ableto listen to the corresponding audio recordings while viewing each imageprint.

[0164] In summary, the main advantage of making an audio recording atthe same time as the corresponding image is captured is that thepertinent information related to the image is more likely to be recordedthan if the audio recording is made some time after the picture istaken, perhaps while viewing the photos a few days or weeks later. Thisis especially true when one takes an extended trip or goes on vacation.This method provides users with a convenient way of recording an audiorecording corresponding to a captured image and receiving back from adeveloper image prints having machine-readable data corresponding to theaudio recording imprinted directly on the image prints for immediateplayback and enjoyment using the display apparatus of the presentinvention. This method is particularly user friendly as the user is notdirectly involved with the intricacies of imprinting themachine-readable data on the image prints.

[0165] Description of a Fourth Further Preferred Embodiment—FIGS. 12 to13.

[0166] In this preferred embodiment, as illustrated in FIGS. 12 and 13,sliding drawer 24, as described in the DESCRIPTION OF A FIRST PREFERREDEMBODIMENT—FIGS. 1 to 6, is replaced by a detachable sliding cartridgeor cassette 224. Each detachable sliding cassette 224 is capable ofholding a stack of image prints 36, which when contained within cassette224 are together referred to as a “portfolio of annotated image prints,”or briefly as a “portfolio”. Even though each of the image printscontained in the stack 36 may be annotated by means previously describedherein, there has up to now been no provision described for annotatingthe entire portfolio itself. For example, one may wish to record a voiceannotation for the portfolio that provides introductory remarks such as:“This collection of thirty-six vacation photos is taken from our trip toItaly in the summer of 2000”. Ideally, this introductory remark isplayed back each time cassette 224 is newly inserted into displayapparatus 18.

[0167] The following is a description of a portfolio annotation systemthat allows the user to create an annotation corresponding to thecontent of the portfolio.

[0168] This preferred embodiment incorporates all of the parts andfunctions of the DESCRIPTION OF A FURTHER PREFERRED EMBODIMENT—FIGS. 7to 10, with some additions and modifications as described below. FIG. 13shows a detachable cassette 224 fully detached from display apparatus18. Cassette 224 is detachable from frame housing 20 of displayapparatus 18 by disengaging the stop members (not shown) that weredescribed in the DESCRIPTION OF A FIRST PREFERRED EMBODIMENT—FIGS. 1 to6. Cassette 224 includes a memory slot 140 into which a storage element142 may be inserted in the direction shown by arrow 150. Memory slot 140has electrical connections to processor 72 through electrical contacts(not shown) in cassette 224 and opposing and complementary electricalcontacts (not shown) in frame housing 20. Memory slot 140 can beconstructed to hold a variety of storage elements 142, preferably acompact storage element is used, such as the MultiMediaCard marketed bySanDisk Corporation of Sunnyvale, Calif., which is about the size of apostage stamp. Storage element 142 is used to hold user annotation, suchas audio data, for the portfolio. Since storage element 142 isremovable, elements of varying capacity can be used depending on thelength of the annotation desired. In addition, storage element 142 mayhold information other than audio information, such as machine data ortext data, for use in other electronic equipment or to exchangeinformation with other devices.

[0169] On the outer surface of cassette 224, there is a place forputting a label 144 used for marling the title of the particularportfolio.

[0170] ROM 77 of controller 23 contains two additional software routines(not shown), one for keeping track of which detachable cassette 224 hasbeing inserted into frame housing 20, and the other for keeping track ofwhich of the image prints in the portfolio is being viewed and playedback within each associated cassette 224. To achieve this trackingfunction, one method is for controller 23 to generate and storechecksums for each cassette and image print. A checksum is a computedvalue which depends on the content of a block of data being examined.Techniques for generating checksum are conventionally known. Forexample, for each detachable cassette 224, controller 23 generates acassette checksum from data read from storage element 142. Controller 23compares the cassette checksum to a cassette checksum previouslygenerated and stored in Non-Volatile Memory 74. If the checksums aredifferent, controller 23 determines that a new cassette 224 has beeninserted. The same technique can be used to keep track of whichannotated image print is being viewed and played back. Each time audiodata is decoded from the machine-readable data on the back surface 46 ofan image print, controller 23 uses the machine-readable data to generatean image checksum, which is stored in storage element 142 for laterretrieval and comparison. Alternatively, a sensor strategically locatedwithin the frame housing 20 may be used to detect only the changing ofcassettes 224.

[0171] For the purpose of recording an audio message corresponding tothe portfolio, display apparatus 18 includes a portfolio recordingswitch 134, connected to processor 72 (see FIG. 12). Recorded audio datacorresponding to the portfolio is stored in storage element 142.

[0172] Operation of Fourth Further Preferred Embodiment—FIGS. 12 to 13

[0173] Operation of the portfolio annotation system describe above, andthe use of tracking information will now be described referring inparticular to FIGS. 12 to 13. The portfolio playback process will bedescribed first, assuming that storage element 142 already containsannotation corresponding to the stack of image prints 36 residing incassette 224 (together referred to as a portfolio). The user insertscassette 224 into frame housing 20 through slot 34 (see FIG. 1). Whencassette 224 is in the fully pushed-in position; storage element 142makes electrical contact with processor 72 through memory slot 140.Controller 23, upon detecting that storage element 142 has beenconnected, reads the contents of storage element 142 and generates acassette checksum. Controller 23 compares this checksum with apreviously generated and stored cassette checksum in the Non-VolatileMemory 74. If different, controller 23 determines that a differentcassette 224 has been inserted and proceeds to play back theintroductory audio information contained within storage element 142,corresponding to the new portfolio. For example, the introductory audiomessage may be: “This is the collection of our vacation photos from ourtrip to Italy in the summer of 2000”, thus giving the user an overviewof the photos about to be viewed. Thereafter, with each pull-out andpush-in of cassette 224, the annotated message corresponding to eachimage print displayed is played back in accordance with previousdescriptions. Whenever a different cassette 224 is inserted into framehousing 20, it is detected and the associated introductory message isplayed back.

[0174] The portfolio annotation recording process will now be described.In general, portfolio annotation is the recording of a messagecharacterizing the portfolio, which is the entire stack of image prints36 contained within detachable cassette 224. For example, the portfoliorecording might say: “This is the collection of our vacation photos fromour trip to Italy in the summer of 2000”, whereas the annotation for anindividual image print within the portfolio might say: “Here is ourfamily standing before the Leaning Tower of Pisa.”, “Here is a beautifulgondola we saw in Venice.” and so on. The portfolio recording can bemade whenever cassette 224 is in the fully pushed-in position withstorage element 142 installed. The portfolio recording is made byactivating portfolio recording switch 134 while speaking into microphone90. Audio data from the portfolio recording is stored in storage element142. Included as well are means to erase and re-record the portfoliomessages.

[0175] Described below are variations of the above recording andplayback scenario whereby several different portfolio audio messages arerecorded and played back for the same portfolio.

[0176] In one such variation, rather than having a user listen to a verylong introductory message when cassette 224 is first inserted into framehousing 20, the portfolio message is divided into several shortermessages for playback at various intervals while viewing and listeningto image print annotations. For example, the following sequence might beused: portfolio message #1, first photo annotation, second photoannotation, portfolio message #2, third photo annotation, fourth photoannotation, portfolio message #3 etc. One possible method for achievingthis playback pattern is as follows: The user first records two veryshort (less than 1 second each) silent portfolio recordings, followed bya series of different portfolio audio messages, which the user wishes tohave played back interleaved between image print annotations. Controller23, is programmed to interpret the two very short blank recordings tomean that after playback of two photo annotations a portfolio messagenext in series should be played back. This interleaved playback ofportfolio messages and image print messages is then continuouslyrepeated. Those skilled in the art will understand and appreciate thatother methods of achieving this same or other playback patterns arepossible.

[0177] In another such variation, a particular portfolio message isassociated with a particular image print being displayed, thus providingadditional or supplemental annotation to the annotation of a particularimage print. This may be desired because the annotation for theindividual image print is not of sufficient length, or new informationhas become available since the individual image print annotation wasmade. One possible method for achieving this result is as follows: Theuser starts with cassette 224 in the pushed-in position, loaded with astack of image prints 36 bearing annotation, and with storage element142 installed. The user cycles through the various image prints untilarriving at the image print for which additional annotation is desired.The user activates portfolio recording switch 134 and records a messagerelevant to the displayed image print. When the recording has beencompleted, controller 23 stores the audio data into storage element 142,along with an image checksum, which is used to associate the audiomessage with the particular image print being displayed. This processcan be repeated for any number of image prints. During playback when animage print is displayed in viewing aperture 26, controller 23 playsback the annotated audio encoded on the back surface 46 of the imageprint. At the same time, controller 23 generates an image checksum andsearches storage element 142 for an identical image checksum. If anidentical image checksum is found, controller 23 retrieves theassociated portfolio message for playback after playback of theannotation for the image print. If an identical image checksum is notfound, no further action is taken as there is no portfolio messageassociated with the displayed image print. Those skilled in the art willunderstand and appreciate that other methods of achieving this resultare possible.

[0178] Even though storage element 142 has been described as releasablydetachable, for manufacturing cost reasons, storage element 142 may alsobe non-removably embedded into cassette 224. In such case, each cassettemay also have an unique identification number embedded within storageelement 142 during the manufacturing process. This then becomes yetanother method for identifying different cassettes 224.

[0179] One of the main problems with photographic image prints is thatthey often remain sitting in shoe boxes or stashed in drawers because:A) there has been no practical method of organizing and displaying thesephotos other than using traditional photo albums which are timeconsuming to organize, bulky to carry, and take up a lot of storagespace; and B) there has been no easy way of annotating photos other thanhand writing some notes on the back of the photos.

[0180] The image and portfolio annotation system described hereinadvantageously allows users to organize and categorize their collectionsof photos into small and easily retrievable portfolios. In addition, anoverview voice annotation for each portfolio offers users greaterenjoyment and comprehension.

[0181] Thus, the reader will appreciate that the above-described methodand apparatus for annotating image prints and portfolios are convenient,efficient, economical and reliable. The resulting annotation will lastas long as the image prints themselves and will not degrade over time orwith use, nor will they be susceptible to accidental erasure. Thecapability of including audio annotation, integral with the image print,greatly improves the documentation, story telling, and memorystimulation features of image prints, thus enhancing the primarypurposes of still image photography. Both old and new photographicprints may be annotated without the need to purchase elaborate andexpensive equipment.

[0182] While not economically feasible at the present time, thoseskilled in the art will be aware that recent advancements in opticaltechnology, such as those used in CD-ROM, DVD, etc., promise a muchhigher data density and capacity, which may be used in the presentinvention for storing data. Holographic data storage is anotherpromising optical technology. For example, holographic materials knownas a photopolymers, developed at Du Pont™, have been used in experimentsto store 1,000 pages of bit patterns in a polymer film 100 micronsthick. Once techniques for reading and writing this data have been fullydeveloped and miniaturized, voice and other data could be stored in aphotopolymer film and applied directly to the back of the image printslike a label. A display apparatus, similar to the display apparatusdescribed herein, could then be used to display the image prints andscan and playback the associated data stored in the photopolymer film.

[0183] The above is a detailed description of particular preferredembodiments of the invention. Those with skill in the art should, inlight of the present disclosure, appreciate that obvious modificationsof the embodiments disclosed herein can be made without departing fromthe spirit and scope of the invention. All of the embodiments disclosedand claimed herein can be made and executed without undueexperimentation in light of the present disclosure. The full scope ofthe invention is set out in the claims that follow and theirequivalents. Accordingly, the claims and specification should not beconstrued to unduly narrow the fill scope of protection to which thepresent invention is entitled.

What is claimed is:
 1. A display apparatus including display means forholding a plurality of image prints and for displaying the image printssuccessively in a viewing aperture, and advance means for sequentiallyadvancing the image prints one at a time to said viewing aperture,comprising: scanning means for scanning a machine-readable data on aback surface of at least one of the plurality of image prints, saidmachine-readable data being integral to said back surface of said atleast one image print; decoding means for decoding said machine-readabledata wherein said machine-readable data comprises audio data, machinedata, or text data; storage means for storing said decodedmachine-readable data corresponding to said at least one scanned imageprint; and playback means for playing back from said storage means saiddecoded machine-readable data corresponding to said at least one scannedimage print when said at least one scanned image print is displayed atsaid viewing aperture, whereby said display apparatus is convenient forboth displaying image prints and for playing back said correspondingdecoded machine-readable data.
 2. An apparatus according to claim 1,wherein said scanning means is an image sensor.
 3. An apparatusaccording to claims 1 or 2, wherein said machine-readable data is atwo-dimensional encodement.
 4. An apparatus according to claims 1, 2 or3, wherein said storage means is a nonvolatile storage element.
 5. Anapparatus according to claims 1, 2, 3 or 4, further including a voicesynthesis means for synthesizing speech from said machine-readable data.6. An apparatus according to claims 1, 2, 3, 4 or 5, further including atransfer means for transferring said machine-readable data to anexternal device.
 7. An apparatus according to claims 1, 2, 3, 4, 5 or 6,further including input means for accepting user input from a touchscreen.
 8. An apparatus according to claims 1, 2, 3, 4, 5, 6 or 7,further including output means for outputting said decodedmachine-readable data for display on an electronic display device.
 9. Adisplay apparatus comprising display means for holding a plurality ofimage prints and for displaying the image prints successively in aviewing aperture, and advance means for sequentially advancing the imageprints one at a time to said viewing aperture, comprising: scanningmeans for scanning a handwritten indicia on the back surface of at leastone of the plurality of image prints; decoding means for decoding saidscanned indicia wherein said indicia contains identification informationunique to said at least one scanned image print; recording means forrecording audio corresponding to said at least one scanned image print;storage means for storing said recorded audio corresponding to said atleast one scanned image print at a unique storage location uniquelyassociated with said identification information; playback means forplaying back from said unique storage location said recorded audiocorresponding to said at least one scanned image print when said atleast one scanned image print is displayed at said viewing aperture,whereby said indicia provides a means to correspond said at least oneimage print with said corresponding audio recording, and whereby saiddisplay apparatus is convenient for both displaying image prints andplaying back audio associated with said image prints.
 10. An apparatusaccording to claim 9, wherein said scanning means is an image sensor.11. An apparatus according to claims 9 or 10, wherein said decodingmeans is optical character recognition processing.
 12. An apparatusaccording to claims 9, 10 or 11, wherein said storage means is anonvolatile storage element releasably attached to said displayapparatus.
 13. An apparatus according to claims 9, 10, 11 or 12, furtherincluding voice synthesis means for synthesizing speech.
 14. Anapparatus according to claims 9, 10, 11, 12 or 13, further includingtransfer means for transferring said recorded audio to an externaldevice.
 15. A method for sequentially displaying a stack of image printsin a display apparatus, comprising the steps of: i) placing said stackof image prints into said display apparatus; ii) scanning amachine-readable data from a back surface of a bottom-most stacked imageprint wherein said machine-readable data comprises audio data, machinedata, or text data, and wherein said machine-readable data is integralto said back surface of said bottom-most stacked image print; iii)decoding said scanned machine-readable data corresponding to saidbottom-most stacked image print and storing said scannedmachine-readable data corresponding to said bottom-most stacked imageprint in a storage means; iv) advancing said bottom-most stacked imageprint to a top-most position of the stack and into a viewing aperture;v) playing back said decoded scanned machine-readable data stored insaid storage means corresponding to said top-most stacked image printdisplayed in said viewing aperture, whereby said display apparatus isconvenient for both displaying image prints and playing back saidmachine-readable data associated with said image prints.
 16. A method asclaimed in claim 15, wherein said display apparatus comprises a framehousing which retains said bottom-most stacked image print, and asliding drawer for retaining the remainder of said stacked image prints,said sliding drawer slidable within said frame housing between a firstfully-in position and a second fully-out position, and comprising thefurther steps of: i) moving said sliding drawer from said fully-inposition to said fully-out position thereby causing said bottom-mostimage print to advance into said viewing aperture; ii) moving saidsliding drawer from said fully-out position back to said fully-inposition thereby causing the remainder of the stacked image prints to bepositioned below said bottom-most image print and causing saidbottom-most image print to be moved to said top-most position of thestack of image prints, and simultaneously scanning said machine-readabledata on a succeeding bottom-most image print for decoding and storing insaid storage means; iii) the movement of said sliding drawer from saidfully-in position to said fully-out position and back to said fully-inposition causing said display apparatus to play back said decodedmachine-readable data stored in said storage means corresponding to saidtop-most image print displayed in said viewing aperture, whereby saiddisplay apparatus cyclically rearranges said stack of image printswithin said display apparatus.
 17. A method as claimed in claims 15 or16, wherein said display apparatus further includes a touch screendisposed at said viewing aperture, said touch screen providing a touchinput means for a user to interact with said top-most image printdisplayed in said viewing aperture.
 18. A method as claimed in claims15, 16 or 17, wherein said display apparatus further includes anelectronic display device providing an output means to electronicallydisplay visual information to a user.
 19. A method of sequentiallydisplaying a stack of image prints in a display apparatus, comprisingthe steps of: i) placing said stack of image prints into said displayapparatus; ii) scanning a handwritten indicia on a back surface of abottom-most stacked image print; iii) decoding said scanned indiciawherein said indicia contains identification information unique to saidbottom-most stacked image print; iv) advancing said bottom-most stackedimage print to a top-most position of the stack and into a viewingaperture; v) recording an audio corresponding to said top-most stackedimage print; vi) storing said recorded audio corresponding to saidtop-most stacked image print in a storage means at a storage locationuniquely associated with said identification information correspondingto said top-most stacked image print; vii) playing back from saidstorage means said recorded audio corresponding to said top-most stackedimage print displayed at said viewing aperture of said displayapparatus, whereby said indicia provides a means to correspond saidtop-most stacked image print with said corresponding audio recording,and whereby said display apparatus is convenient for both displayingimage prints and playing back audio associated with said image prints.20. A method as claimed in claim 19, wherein said display apparatuscomprises a frame housing which retains said bottom-most stacked imageprint and a sliding drawer for retaining the remainder of said stackedimage prints, said sliding drawer slidable within said frame housingbetween a first fully-in position and a second fully-out position, andcomprising the further steps of: i) moving said sliding drawer from saidfully-in position to said fully-out position, thereby causing saidbottom-most image print to advance into said viewing aperture; ii)moving said sliding drawer from said fully-out position back to saidfully-in position thereby causing the remainder of the stacked imageprints to be positioned below said bottom-most image print and causingsaid bottom-most image print to be moved to a top-most position of thestack of image prints, and simultaneously scanning said handwrittenindicia on a succeeding bottom-most image print for decoding and storingin said storage means; iii) the movement of said sliding drawer fromsaid fully-in position to said fully-out position and back to saidfully-in position causing said display apparatus to play back saidrecorded audio stored in said storage means corresponding to saidtop-most image print displayed in said viewing aperture, whereby saiddisplay apparatus cyclically rearranges said stack of image printswithin said display apparatus.
 21. A method as claimed in claims 15, 16,17 or 18, wherein said machine-readable data is made integral to saidback surface of said bottom-most stacked image print by a methodcomprising the steps of: i) making an audio recording corresponding tosaid bottom-most stacked image print using a recording device; ii)converting said audio recording into said machine-readable data using analgorithmic encoding process, wherein said machine-readable data is atwo-dimensional encodement format; and iii) printing saidmachine-readable data using a printing device and integrating saidmachine-readable data with said back surface of said bottom-most stackedimage print, whereby said audio recording is made integral to saidbottom-most stacked image print.
 22. A method as claimed in claims 19 or20, including the further steps of: i) outputting from said displayapparatus a recorded audio corresponding to at least one of said stackedimage prints; ii) converting said at least one audio recording into amachine-readable data using an algorithmic encoding process, whereinsaid machine-readable data is a two-dimensional encodement format; iii)printing said machine-readable data using a printing device andintegrating said machine-readable data with a back surface of said atleast one corresponding image print, whereby said audio recording ismade integral to said at least one corresponding image print.
 23. Amethod of recording a machine-readable data on a back surface of animage print, the machine-readable data representative of an audiorecording corresponding to the image print, comprising the steps of: i)outputting the audio recording from a display apparatus used to recordthe audio recording; ii) converting the audio recording into saidmachine-readable data using an algorithmic encoding process, whereinsaid machine-readable data is a two-dimensional encodement format, iii)printing said machine-readable data using a printing device andintegrating said machine-readable data with the back surface of thecorresponding image print, whereby the audio recording is made integralto the image print.
 24. An annotation and display apparatus, comprising:i) display means for holding a plurality of image prints and fordisplaying said image prints successively in a viewing aperture; ii)advance means for sequentially advancing said image prints one at a timeto said viewing aperture; iii) recording means for recording an audiomessage corresponding to at least one of said image prints; iv) encodingmeans for encoding said recorded audio message into a machine-readabledata; v) imprinting means for imprinting said machine-readable data andintegrating said machine-readable data on a back surface of said atleast one image print; vi) scanning means for scanning saidmachine-readable data integral on the back surface of said at least oneimage print; vii) decoding means for decoding said machine-readable datainto a decoded audio message corresponding to said at least one imageprint; viii) playback means for playing back said decoded audio messagewhen said at least one image print is displayed in said viewing apertureof said display apparatus whereby said display apparatus is convenientfor displaying image prints and for imprinting and playing back saidcorresponding decoded audio messages.
 25. An apparatus according toclaim 24, wherein said imprinting means prints said machine-readabledata directly on the back surface of said at least one image print, oron a label and then affixes said label to the back surface of said atleast one image print.
 26. An apparatus according to claims 24 or 25,wherein said machine-readable data is a two-dimensional encodementformat.
 27. An apparatus according to claims 24, 25 or 26, wherein saidscanning means is an image sensor.
 28. An apparatus according to claims24, 25, 26 or 27, wherein the display apparatus is portable and batteryoperated.
 29. A method of annotating and displaying image prints using adisplay apparatus comprising the steps of: i) recording an audio messagecorresponding to at least one of said image prints; ii) encoding saidrecorded audio message into a machine-readable data; iii) imprintingsaid machine-readable data using an imprinter attached to said displayapparatus, and integrating said machine-readable data on a back surfaceof said at least one image print; iv) scanning said machine-readabledata integral on said back surface of said at least one image print; v)decoding said machine-readable data into a decoded audio messagecorresponding to said at least one image print; vi) displaying said atleast one image print in a viewing aperture of said display apparatusand vii) playing back said decoded audio message corresponding to saiddisplayed image print, whereby said recorded audio message is madeintegral to the back surface of said at least one image print and isplayed back while said at least one image print is displayed in saiddisplay apparatus.
 30. A method according to claim 29, wherein saiddisplay apparatus has display means for holding a plurality of saidimage prints and for displaying said image prints successively in saidviewing aperture and advance means for sequentially advancing said imageprints one at a time to said viewing aperture.
 31. A method according toclaims 29 or 30, wherein said imprinter prints said machine-readabledata directly on the back surface of said at least one image print, oron a label and then affixes said label to the back surface of said atleast one image print.
 32. A method for combining images withcorresponding audio messages and for displaying said images and playingback said corresponding audio messages in a display apparatus comprisingthe steps of: i) capturing at least one said image using a camera, saidcamera also capable of recording said corresponding audio messages; ii)using said camera to record at least one said corresponding audiomessage for said at least one image in a storage medium; iii) producingan image print from said at least one captured image; iv) encoding saidat least one recorded corresponding audio message stored in said storagemedium into a machine-readable data; v) imprinting said machine-readabledata and integrating said machine-readable data on a back surface ofsaid image print; vi) scanning said machine-readable data integral onthe back surface of said image print; vii) decoding saidmachine-readable data into a decoded audio message corresponding to saidimage print; viii) displaying said image print in a viewing aperture ofsaid display apparatus; and ix) playing back said decoded audio messagecorresponding to said displayed image print, whereby said at least onerecorded audio message made while capturing said at least one image ismade integral to the back surface of said corresponding image print andis played back while said image print is displayed in said displayapparatus.
 33. A method as claimed in claim 32, wherein said displayapparatus has display means for displaying said image printssuccessively in a viewing aperture, and advance means for sequentiallyadvancing said image prints one at a time to said viewing aperture. 34.A method as claimed in claims 32 or 33, wherein said machine readabledata is a two-dimensional encodement format.
 35. A method as claimed inclaims 32, 33 or 34, wherein said storage medium is a solid state memoryelement affixed to a film cartridge or canister used to store saidimages.
 36. A method as claimed in claims 32, 33, 34 or 35, wherein saidcamera is a single-use camera.
 37. A method as claimed in claims 32, 33,34 or 35, wherein said camera is a digital camera.
 38. A portfolioannotation apparatus, comprising: i) a detachable cassette for holdingimage prints, said cassette and said image prints comprising aportfolio; ii) a portfolio recording means for recording datacharacterizing said portfolio, wherein said data comprises audio data,machine data, or text data; iii) a storage means attached to saidcassette for storing said data; and iv) a portfolio playback means forplaying back from said storage means said data characterizing saidportfolio; whereby said cassette is a convenient means for organizingand categorizing image prints and said portfolio recording means is aconvenient way to characterize the content of said portfolio for storageand later playback.
 39. An apparatus according to claim 38, wherein saidapparatus includes display means for displaying said image printssuccessively in a viewing aperture, and advance means for sequentiallyadvancing said image prints one at a time from said cassette to saidviewing aperture.
 40. An apparatus according to claims 38 or 39, whereinsaid image prints have annotation made integral therewith.
 41. Anapparatus according to claims 38, 39 or 40, wherein said storage meansis releasably attached to said cassette.
 42. A method of annotating aportfolio of image prints comprising the steps of: i) placing at leastone image print into a detachable cassette, said at least one imageprint and said cassette comprising said portfolio; ii) placing saidportfolio into an apparatus, said apparatus having recording andplayback means; iii) recording data corresponding to said portfolio,wherein said data comprise audio data, machine data, or text data; iv)storing said data in a storage element attached to said cassette; and v)playing back from said storage element said data corresponding to saidportfolio; whereby using said detachable cassettes is a convenient wayto organize and categorize image prints into said portfolios, andrecording data corresponding to said portfolios is a convenient way tocharacterize the content of said portfolios for storage and laterplayback.
 43. A method as claimed in claim 42, wherein said apparatusincludes display means for displaying said image prints successively ina viewing aperture, and advance means for sequentially advancing saidimage prints one at a time from said cassette to said viewing aperture.44. A method as claimed in claims 42 or 43, wherein image prints havingannotation made integral therewith.
 45. A method as claimed in claims42, 43 or 44, wherein said storage element is releasably attached tosaid cassette.